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to the processor, the imaging MPS sensor being firmly attached to the image detector, the two-dimensional imaging system being 
coupled to the processor, the image detector being firmly attached to an imaging catheter. 
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MEDICAL IMAGING AND NAVIGATION SYSTEM 

CROSS REFERENCE INFORMATION 

This application is a Continuation-in-Part of application No. 
09/782,528, filed February 13, 2001, which is a Continuation-in-Part of 
application No 09/314,474, filed May 18, 1999. 

FIELD OF THE DISCLOSED TECHNIQUE 

The disclosed technique relates to medical diagnostic and 
surgery systems and methods in general, and to methods and systems for 
three-dimensional medical imaging and navigation, in particular. 

BACKGROUND OF THE DISCLOSED TECHNIQUE 

Methods and systems for acquiring and presenting two- 
dimensional and three-dimensional images are known in the art. Three- 
dimensional imaging enhances modern diagnostics, therapy and surgery 
procedures. 

A two-dimensional imaging system processes and represents 
two-dimensional internal body slices in static or in dynamic form on a 
display. A conventional two-dimensional ultrasound imaging system 
includes an ultrasound transducer, an image capturing module and an 
image-processing unit. 

The ultrasound transducer is placed in close proximity to the 
tissue to be examined. The ultrasound transducer converts an electrical 
signal to ultrasonic waves and directs the waves toward the examined 
tissue. The ultrasonic waves are in part absorbed, dispersed, refracted 
and reflected. The ultrasound transducer detects the ultrasonic reflections. 
The ultrasound transducer converts the reflected ultrasonic waves to an 
electrical signal and provides it to the image-processing unit. 
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The image-processing unit processes the received electrical 
signal, thereby producing a plurality of two-dimensional images of slices of 
the inspected tissue. The image-capturing module captures each two- 
dimensional image and can provide each of them to a display or a printer. 

5 US Patent No. 5,152,290 to Freeland, entitled "Method for 

recording ultrasound images to diagnose heart and coronary artery 
disease" is directed to a method for capturing and displaying two- 
dimensional ultrasound images of the heart for diagnosing heart disease, 
such as coronary artery disease. The method disclosed by Freeland 

10 includes the procedures of detecting an electrocardiogram (ECG) signal 
after peak exercise, detecting the two-dimensional images of the heart, 
storing selected images, each with the ECG reading at the time that the 
image was taken and displaying a quad-image group. The system detects 
and records a two-dimensional image sequence continuously at a rate of 

15 at least eight images per heartbeat. 

US Patent No. 5,690,113, issued to Sliwa, Jr. et al., entitled 
"Method and apparatus for two-dimensional ultrasonic imaging" is directed 
to a method and apparatus for generating a two-dimensional ultrasonic 
image using a hand-held single element transducer probe, having a fixed 

20 scan-line. The system provides displaying two-dimensional ultrasonic 
images of the body of a patient. This system detects two-dimensional 
ultrasonic images, and determines the spatial location and orientation of 
the ultrasound transducer, at the same time. The system includes a probe 
with an ultrasound transducer, capable of imaging a single scan-line and a 

25 means for tracking the spatial location and orientation of the ultrasound 
transducer. The scan-line is fixed in an orientation and spatial position 
relative to the movable transducer. The system further includes a 
computing means, which computes the spatial location and the orientation 
of each scan-line as the transducer is moved. Thereby, the scan-lines are 

30 presented as a complete image. Alternatively, an electromagnetic 
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transmitter and a receiving sensor determine the spatial orientation and 
position of each scan-line in free space. 

A typical three-dimensional ultrasound imaging system includes 
a conventional two-dimensional ultrasound imaging system, a location and 
orientation detection system, an image processing system and a 
displaying system. Such systems provide three-dimensional imaging of 
internal organs such as the liver, kidneys, gallbladder, breast, eyes, brain, 
and the like. 

The location and orientation detection system provides the 
location and orientation of ultrasound transducer. The location and 
orientation of each of the captured two-dimensional images are 
determined from the location and orientation of the transducer. 

The image processing system reconstructs a three-dimensional 
image of the inspected organ, by processing the captured two-dimensional 
images, each according to the location and orientation thereof. Finally, the 
displaying system displays the received three-dimensional image of the 
inspected organ. 

US Patent No. 5,787,889 issued to Edwards et al., and entitled 
"Ultrasound imaging with real time 3D image reconstruction and 
visualization" is directed to generation and visualization of three- 
dimensional ultrasound images. The method disclosed by Edwards 
includes the following procedures: acquiring data, reconstructing a volume, 
and visualizing an image. The system provides for achieving and 
visualizing three-dimensional ultrasound images with a two-dimensional 
ultrasound medical imaging system included therein. An operator can 
perform various visualization tasks on the reconstructed three-dimensional 
image, such as rotating the image in different viewing angles and plans. 

Another type of three-dimensional imaging system, which is 
known in the art, is operative to produce a motion picture of the heart or 
the lungs. This system includes a conventional two-dimensional ultrasound 

imaging system, an ECG monitor, a location and orientation detection 
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system, an image processor and a display system. The ECG monitor 
detects the timing signal of the heart. The ECG timing signal is used to 
synchronize or trigger the recording of the two-dimensional images 
representative of selected points in the ECG timing signal. The ultrasound 

5 transducer detects two-dimensional ultrasound images of the heart at any 
given moment (e.g., at a selected point of time on ECG timing signal). 
Each two-dimensional image represents a specific slice of the heart 
according to the specific activity-state thereof. The location and orientation 
of each of the two-dimensional images are directly determined from the 

10 location and orientation of the transducer. 

The image processor reconstructs a three-dimensional image of 
the heart from captured two-dimensional images having the same activity- 
state. Finally, the display system displays a sequence of the reconstructed 
images, thereby presenting a three-dimensional motion picture of the 

is heart. 

US Patent No. 5,924,989 issued to Polz, and entitled "Method 
and device for capturing diagnostically acceptable three-dimensional 
ultrasound image data records", is directed to a method and a system for 
generating a three-dimensional image sequence of the heart. This system 

20 includes a three-dimensional ultrasound imaging system, combined with 
an echocardiograph. The system detects two-dimensional ultrasound 
images and stores each of them together with the location and orientation 
thereof and with the organ cycle location as provided by the 
echocardiogram, at the time that the image was acquired. Utilizing a 

25 special algorithm, the system reconstructs a three-dimensional image from 
all of the two-dimensional images having the same organ cycle location, 
and displays a sequence of the reconstructed three-dimensional images. 

US Patent No. 5,830,145 issued to Tenhoff and entitled 
"Enhanced Accuracy of Three-Dimensional Intraluminal Ultrasound (ILUS) 

30 Image Reconstruction", is directed to a system and a method for imaging 
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an organ within a body. The system of Tenhoff is described herein below, 
with reference to Figures 13A and 13B. 

Figure 13A is a schematic illustration of a system for displaying a 
three-dimensional image of an organ, generally referenced 10, which is 
known in the prior art. Figure 13B is a schematic illustration of the 
trajectory of the imaging tip of the catheter of the system of Figure 1 3A, 
inside an artery of the patient. 

With reference to Figure 13A, system 10 includes a catheter 12, 
an automatic pull-back device 14, a processing system 16, a chest 
harness 18 and a catheter tracking system (not shown). The proximal end 
of catheter 12 includes a handle 20. Processing system 16 includes a 
control console, an ultrasound transceiver and a display. Catheter 12 
includes a catheter imaging tip (not shown) located at the distal end 
thereof. The catheter imaging system is an intraluminal ultrasound (ILUS) 
transducer (not shown). The catheter tracking system includes at least one 
tracking transducer (not shown), mounted on catheter 12 and typically 
adjacent the catheter imaging tip. The catheter tracking system further 
includes a plurality of reference frame transducers located within chest 
harness 18. Each of the tracking transducers and the reference frame 
transducers, is an ultrasound transducer. The reference frame transducers 
define the origin of a global coordinate system. In another embodiment of 
the patent, the catheter imaging system is an optical coherence 
tomography (OCT) imaging system. 

Handle 20 is coupled to automatic pull-back device 14. The 
reference frame transducers are coupled to processing system 16 by wires 
24. The tracking transducers are coupled to processing system 16 by 
wires 26. The catheter imaging system is coupled to processing system 16 
by wires 28. Automatic pull-back device 14 is coupled to processing 
system 16 by wires 30. 

The operator (not shown) enters catheter 12 in the body of a 

patient 22 through the femoral artery and positions catheter 12 within a 
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region of interest (e.g., the coronary arteries). The catheter imaging 
system provides a plurality of two-dimensional images (e.g., echographic 
images in case of an ILUS transducer) of the area which surrounds the 
catheter imaging tip, when the catheter imaging tip is located in the region 
of interest. 

The catheter imaging system is carried through a pull-back 
sequence, optionally using automatic pull-back device 14. The 
echographic data sets obtained during pull-back, provide the necessary 
input to produce an image to be displayed on the display. During the pull- 
back of the catheter imaging tip, processing system 16 records the 
position (X, Y, Z) and the time at each interval for which data is recorded. 

The angulation in three dimensional space of the catheter 
imaging tip, for each image, is determined by using the coordinates of one 
or more of the tracking transducers. A pair of transducers marks the 
location of the catheter imaging tip during the pull-back. The pair of closely 
spaced transducers define a line which calculates the tangent to the curve 
defined by the catheter imaging tip at that point. The tangent is calculated 
by the line defined by the two or more points determined by the location of 
the tracking transducers. 

In another embodiment of the patent, a single marker transducer 
is employed to mark the location of the catheter imaging tip during pull- 
back. In this case, the tangent is calculated by the line through two points 
determined by the successive locations of the marker transducer at two 
positions during the pull-back. 

Processing system 16 uses the coordinates (X, Y, Z) of each 
echographic image acquired along the catheter pull-back path, in 
conjunction with the time data, to reconstruct a three-dimensional image. 
Each three-dimensional image is reconstructed by stacking the 
echographic images around the catheter pull-back trajectory. 

With further reference to Figure 13B, processing system 16 

(Figure 13A) generates a trajectory 50 of the imaging tip of catheter 12 
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during pull-back and the display displays trajectory 50 with reference to the 
origin of the global coordinate system. Trajectory 50 is defined by a 
plurality of points in the global coordinate system, such as points 52, 54, 
56, 58, 60, 62, 64, 66 and 68. Each of the points 52, 54, 56, 58, 60, 62, 64, 

5 66 and 68 corresponds to a different position of the catheter imaging tip 
during pull-back. 

However, it is noted that during the pull-back sequence, the 
artery constantly moves to different positions such as positions 70, 72 and 
74, and the location and orientation of the artery with respect to the origin 

10 of the global coordinate system, changes. Thus, trajectory 50 of catheter 
12 does not represent the true trajectory of catheter 12 within the artery 
and trajectory 50 is substantially inaccurate. 

Optical Coherence Tomography (OCT) is a general name for a 
method optically scans through tissue at very high resolution. OCT 

is measures the intensity of back-reflected infrared light and yields imaging 
resolution, which is 5-25 times greater than other current clinical imaging 
technologies, such as ultrasound. 

US patent No. 6,134,003 to Tearney et al., entitled "Method and 
apparatus for performing optical measurements using a fiber optic imaging 

20 guidewire, catheter or endoscope", US patent No. 6,175,669 to Colston et 
al., entitled "Optical coherence domain reflectometry guidewire" and US 
patent No. 5,994,690 to Kulkarni et al., entitled "Image enhancement in 
optical coherence tomography using deconvolution" are all directed to 
methods and system using OCT imaging technology. 

25 Intra-vascular plaques may be prone to rupture and may 

provoke fatal vessel obstruction. These plaques often exhibit a different 
temperature than other inner vessel structures and hence, can be 
detected and consequently treated according to a temperature map of the 
inner layers of the vessel. Methods and systems for intra-vascular 

30 temperature mapping are known in the art, and are conventionally based 
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on Infrared technology, using optic fibers, which are inserted into the blood 
vessel, for detecting "hot" plaques. This technique is called thermography. 
US patent no 5,935,075 to Casscells et al., entitled "Detecting Thermal 
Discrepancies in Vessel Walls" is directed to a system for analyzing 
5 optical radiation in blood vessels, which attempts to detect "hot" 
plaques. 
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SUMMARY OF THE DISCLOSED TECHNIQUE 

It is an object of the disclosed technique to provide a novel 
method and system for medical in-vivo invasive probing. In accordance 
with the disclosed technique, there is thus provided a medical imaging and 
navigation system. The system includes a processor, a display unit, a 
database, a medical positioning system (MPS), a two-dimensional imaging 
system, an inspected organ monitor interface, and a superimposing 
processor. 

The MPS includes a transducer MPS sensor and a surgical tool 
MPS sensor. The two-dimensional imaging system includes an imaging 
transducer. The processor is coupled with the display unit, the database, 
the MPS, the two-dimensional imaging system, the inspected organ 
monitor interface, and to the superimposing processor. The inspected 
organ monitor interface is further coupled with an organ monitor. The 
surgical tool MPS sensor is firmly attached to a surgical tool. The 
transducer MPS sensor is firmly attached to the imaging transducer. The 
organ monitor monitors an organ timing signal associated with an 
inspected organ. The system reconstructs a plurality of three-dimensional 
images from a plurality of detected two-dimensional images, according to 
the respective location and orientation of each two-dimensional image and 
its position within the inspected organ timing signal. Since the all of the 
MPS sensors belong to the same MPS system, the system provides the 
location and orientation of the surgical tool, within the same coordinate 
system of the detected two-dimensional images. 

In accordance with another aspect of the disclosed technique, 

there is thus provided a medical imaging and navigation system. The 

system includes a processor, a display unit, a database, an MPS, an 

inspected organ monitor interface and a superimposing processor. The 

processor is coupled with the display unit, the database, the MPS, the 

inspected organ monitor interface and to the superimposing processor. 

The inspected organ monitor interface is coupled with an organ monitor. 
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The MPS includes a surgical tool MPS sensor being firmly attached to a 
surgical tool. The organ monitor monitors an organ timing signal 
associated with an inspected organ. This system is adapted to operate on 
pre-stored images. 

In accordance with a further aspect of the disclosed technique, 
there is thus provided a method for displaying an image sequence of a 
moving inspected organ. The method includes the procedures of detecting 
an organ timing signal of the inspected organ, detecting a plurality of two- 
dimensional images of the inspected organ using an image detector, and 
detecting the location and orientation of the image detector. The method 
further includes the procedures of associating each of the two-dimensional 
images with the image detector location and orientation and with the 
detected organ timing signal, and reconstructing a plurality of three- 
dimensional images from the two-dimensional images. The method further 
includes the procedures of selecting one of the three-dimensional images 
according to a real-time reading of the organ timing signal, and displaying 
the selected three-dimensional image. 

In accordance with another aspect of the disclosed technique, 
there is thus provided a method for displaying an image sequence of a 
moving inspected organ. The method includes the procedures of detecting 
an organ timing signal of the inspected organ, and selecting one of a 
previously stored three-dimensional images according to a real-time 
reading of the organ timing signal. The method further includes the 
procedures of detecting the location and orientation of a surgical tool, 
superimposing a representation of the surgical tool onto the selected 
three-dimensional image, and displaying the superimposed three- 
dimensional image. 

In accordance with a further aspect of the disclosed technique, 
there is thus provided a method for displaying an image sequence of a 
moving inspected organ. The method includes the procedures of detecting 

an organ timing signal of the inspected organ, detecting the location and 
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orientation of a point of view of a user and selecting one of a previously 
stored three-dimensional images according to a real-time reading of the 
organ timing signal. The method further includes the procedures of 
rendering the selected three-dimensional image according to the detected 
location and orientation of the point of view and displaying the selected 
three-dimensional image. 

In accordance with another aspect of the disclosed technique, 
there is thus provided a method for displaying an image sequence of a 
moving inspected organ. Each image in the image sequence is associated 
with the location and orientation of the image within a predetermined 
coordinate system. The method includes the procedures of detecting an 
organ timing signal of the inspected organ, selecting one of a previously 
stored two-dimensional images according to a real-time reading of the 
organ timing signal and displaying the selected two-dimensional image. 
This system is adapted for a two-dimensional imaging and displaying 
environment. 

In accordance with a further aspect of the disclosed technique, 
there is thus provided a medical imaging and navigation system. The 
system includes a processor, a display unit, a database, a medical 
positioning system (MPS), a two-dimensional imaging system, an 
inspected organ monitor interface, and a superimposing processor. 

The MPS includes a transducer MPS sensor and a surgical tool 

MPS sensor. The two-dimensional imaging system includes an imaging 

transducer. The processor is coupled to the display unit, the database, the 

MPS, the two-dimensional imaging system, the inspected organ monitor 

interface, and to the superimposing processor. The inspected organ 

monitor interface is further coupled to an organ monitor. The surgical tool 

MPS sensor is firmly attached to a surgical tool. The transducer MPS 

sensor is firmly attached to the imaging transducer. The organ monitor 

monitors an organ timing signal associated with an inspected organ. The 

system reconstructs a plurality of three-dimensional images from a 
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plurality of detected two-dimensional images, according to the respective 
location and orientation of each two-dimensional image and its position 
within the inspected organ timing signal. Since the all of the MPS sensors 
belong to the same MPS system, the system provides the location and 
orientation of the surgical tool, within the same coordinate system of the 
detected two-dimensional images. 

In accordance with another aspect of the disclosed technique, 
there is thus provided a medical imaging and navigation system. The 
system includes a processor, a display unit, a database, an MPS, an 
inspected organ monitor interface and a superimposing processor. The 
processor is coupled to the display unit, the database, the MPS, the 
inspected organ monitor interface and to the superimposing processor. 
The inspected organ monitor interface is coupled to an organ monitor. The 
MPS includes a surgical tool MPS sensor being firmly attached to a 
surgical tool. The organ monitor monitors an organ timing signal 
associated with an inspected organ. This system is adapted to operate on 
pre-stored images. 

In accordance with a further aspect of the disclosed technique, 
there is thus provided a method for displaying an image sequence of a 
moving inspected organ. The method includes the procedures of detecting 
an organ timing signal of the inspected organ, detecting a plurality of two- 
dimensional images of the inspected organ using an image detector, and 
detecting the location and orientation of the image detector. The method 
further includes the procedures of associating each of the two-dimensional 
images with the image detector location and orientation and with the 
detected organ timing signal, and reconstructing a plurality of three- 
dimensional images from the two-dimensional images. The method further 
includes the procedures of selecting one of the three-dimensional images 
according to a real-time reading of the organ timing signal, and displaying 
the selected three-dimensional image. 
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In accordance with another aspect of the disclosed technique, 
there is thus provided a method for displaying an image sequence of a 
moving inspected organ. The method includes the procedures of detecting 
an organ timing signal of the inspected organ, and selecting one of 
previously stored three-dimensional images according to a real-time 
reading of the organ timing signal. The method further includes the 
procedures of detecting the location and orientation of a surgical tool, 
superimposing a representation of the surgical tool onto the selected 
three-dimensional image, and displaying the superimposed three- 
dimensional image. 

In accordance with a further aspect of the disclosed technique, 
there is thus provided a method for displaying an image sequence of a 
moving inspected organ. The method includes the procedures of detecting 
an organ timing signal of the inspected organ, detecting the location and 
orientation of a point of view of a user and selecting one of previously 
stored three-dimensional images according to a real-time reading of the 
organ timing signal. The method further includes the procedures of 
rendering the selected three-dimensional image according to the detected 
location and orientation of the point of view and displaying the selected 
three-dimensional image. 

In accordance with another aspect of the disclosed technique, 
there is thus provided a method for displaying an image sequence of a 
moving inspected organ. Each image in the image sequence is associated 
with the location and orientation of the image within a predetermined 
coordinate system. The method includes the procedures of detecting an 
organ timing signal of the inspected organ, selecting one of a previously 
stored two-dimensional images according to a real-time reading of the 
organ timing signal and displaying the selected two-dimensional image. 
This system is adapted for a two-dimensional imaging and displaying 
environment. 
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In accordance with a further aspect of the disclosed technique, there 
is thus provided a medical imaging and navigation system. The medical 
imaging and navigation system includes a processor, an MPS, a two- 
dimensional imaging system and an inspected organ monitor interface. 
The MPS includes an imaging MPS sensor and the two-dimensional 
imaging system includes an image detector. The processor is coupled to a 
display unit, the inspected organ monitor interface, a database, and to the 
MPS. The inspected organ monitor interface is further coupled with an 
organ monitor. The imaging MPS sensor is firmly attached to the image 
detector. The two-dimensional imaging system is coupled to the 
processor. The image detector is firmly attached to an imaging catheter. 
The image detector is an optical coherence tomography detector, an 
ultrasound detector, a magnetic resonance imaging detector, 
thermography detector, and the like. 

The image detector detects two-dimensional images of an inspected 
organ. The organ monitor monitors an organ timing signal associated with 
the inspected organ. The imaging MPS sensor provides information 
respective of the location and orientation of the image detector, to the 
MPS. The processor associates each of the detected two-dimensional 
images with the respective location and orientation information and with 
the organ timing signal, and reconstructs a three-dimensional image of the 
inspected organ, according to the two-dimensional images. 

In accordance with another aspect of the disclosed technique, there 
is thus provided a medical imaging and navigation system. The medical 
imaging and navigation system includes a processor, an MPS and an 
inspected organ monitor interface. The MPS includes a catheter MPS 
sensor. The processor is coupled to a display unit, the MPS, an inspected 
organ monitor interface and to a database. The inspected organ monitor 
interface is coupled to an organ monitor. The catheter MPS sensor is 
firmly attached to a surgical tool and the surgical tool is firmly attached to a 
surgical catheter. 

-14- 



WO 02/064011 



PCT/IL02/00108 



The organ monitor monitors an organ timing signal associated with 
the inspected organ. The catheter MPS sensor provides information 
respective of the location and orientation of the surgical tool, to the MPS. 
The processor reconstructs a three-dimensional image of the inspected 
organ, according to the location and orientation information associated 
with the two-dimensional images, and according to a real time organ 
timing signal reading. The processor superimposes a representation of the 
surgical tool, and a representation of a trajectory of the image detector on 
the reconstructed three-dimensional image, according to the location and 
orientation information respective of the surgical tool. 

In accordance with a further aspect of the disclosed technique, there 
is thus provided a graphical user interface. The graphical user interface 
includes a plurality of windows, wherein each window presents an image 
of the inspected organ. The image is selected according to the organ 
timing signal. The image can be an external three-dimensional image of 
the inspected organ, an internal three-dimensional image thereof, an 
historical two-dimensional image thereof, a real time two-dimensional 
image of the portion of the body of the patient which includes the 
inspected organ, and the like. For example, a projection of the external 
three-dimensional image, a representation of a surgical tool and a 
representation of a trajectory of an imaging catheter are superimposed on 
the real time two-dimensional image. Furthermore, a representation of the 
surgical tool and a representation of the trajectory, are superimposed on 
the internal three-dimensional image. The ECG of the patient is also 
displayed, wherein the operator can play a pseudo-video three- 
dimensional image of the inspected organ, according to the ECG, forward 
or backward in time or at a selected point in the ECG. 

In accordance with another aspect of the disclosed technique, there 
is thus provided a method for displaying the occluded regions of the 
inspected organ. The method includes the procedures of comparing a 
plurality of occlusion values of the inspected organ, with a selected 
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occlusion value, determining the occluded regions according to the 
outcome of the comparison and producing a presentation of the occluded 
regions. The operator selects an occlusion threshold and those occlusion 
regions of the inspected organ whose occlusion values are greater than 
the selected occlusion threshold, are superimposed on a three- 
dimensional image of the inspected organ. 

In accordance with a further aspect of the disclosed technique, there 
is thus provided a method for displaying an image sequence of a moving 
inspected organ. The method includes the procedures of detecting an 
organ timing signal of the inspected organ and detecting a plurality of two- 
dimensional images of the inspected organ by using an image detector. 
The method further includes the procedures of detecting a real time two- 
dimensional image of the inspected organ, detecting the location and 
orientation of the image detector, and detecting the location and 
orientation of a surgical tool. 

The method further includes the procedures of associating each of 
the two-dimensional images with the image detector location and 
orientation and with the detected organ timing signal, and reconstructing a 
plurality of three-dimensional images from the two-dimensional images. 
The method further includes the procedures of selecting one of the three- 
dimensional images according to a real-time reading of the organ timing 
signal and displaying the selected three-dimensional image. The organ 
timing signal defines an organ timing signal cycle. Each of the three- 
dimensional images is reconstructed from selected two-dimensional 
images, wherein the selected two-dimensional images correspond to a 
selected position within the organ timing signal cycle. The processor 
superimposes a projection of the reconstructed three-dimensional image 
of the inspected organ and a representation of the surgical tool, on the 
detected real time two-dimensional image of the inspected organ. 

In accordance with another aspect of the disclosed technique, there 
is thus provided a method for reconstructing an image. The method 
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includes the procedures of determining translated coordinates for an 
auxiliary two-dimensional image, which belongs to an activity-state other 
than a selected activity-state and associating the auxiliary two-dimensional 
image with the selected activity-state, according to the translated 

5 coordinates. The processor reconstructs the three-dimensional image from 
the auxiliary two-dimensional images which belong to activity-states other 
than the selected activity-states, as well as those two-dimensional images 
which belong to the selected activity-state. Thus, a much more detailed 
image is obtained, if only the images, which belong to the selected activity- 

10 state, were used. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The disclosed technique will be understood and appreciated 
more fully from the following detailed description taken in conjunction with 
the drawings in which: 

Figure 1 is a schematic illustration of a multi functional three- 
dimensional imaging system, constructed and operative in accordance 
with an embodiment of the disclosed technique; 

Figure 2A is an illustration in perspective of an inner-body radial 
ultrasound imaging system, constructed and operative in accordance with 
another embodiment of the disclosed technique; 

Figure 2B is an illustration in perspective of a plurality of radial 
two-dimensional images of the walls of an inspected vessel; 

Figure 2C is a schematic illustration in detail of the MPS system 
of Figure 1, constructed and operative in accordance with a further 
embodiment of the disclosed technique; 

Figure 3 is a schematic illustration of a two-dimensional image in 
a given coordinate system; 

Figure 4 is an illustration in perspective of a plurality of two- 
dimensional images and an organ timing signal; 

Figure 5A is a schematic illustration of a plurality of three- 
dimensional volumes, according to another embodiment of the disclosed 
technique; 

Figure 5B is a schematic illustration of some of the three- 
dimensional volumes of Figure 5A, at a later stage of image 
reconstruction; 

Figure 5C is a schematic illustration of a selected three- 
dimensional volume of Figure 5A, going through a procedure of image 
updating; 

Figure 5D is a schematic illustration of a two-dimensional image, 
which includes foreign object information; 
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Figure 6 is a schematic illustration of a method for operating the 
three-dimensional imaging system of Figure 1, operative in accordance 
with a further embodiment of the disclosed technique; 

Figure 7A is a schematic illustration of a real-time three- 
dimensional display playback system, constructed and operative in 
accordance with another embodiment of the disclosed technique; 

Figure 7B is a schematic illustration of the goggles of Figure 7A, 
displaying a three-dimensional image of the heart of a patient; 

Figure 8 is an illustration in perspective of a cyclical sequence of 
three-dimensional images, according to a further embodiment of the 
disclosed technique; 

Figure 9 is a schematic illustration of a superimposing process, 
operative in accordance with another embodiment of the disclosed 
technique; 

Figure 10 is a schematic illustration of a method for operating 
the system of Figure 7A, operative in accordance with a further 
embodiment of the disclosed technique; 

Figure 11 is an illustration in perspective of an inner-vascular 
imaging and surgery system, constructed and operative in accordance 
with another embodiment of the disclosed technique; 

Figure 12 is a schematic illustration of a multi function two- 
dimensional imaging system, constructed and operative in accordance 
with a further embodiment of the disclosed technique; 

Figure 13A is a schematic illustration of a system for displaying a 
three-dimensional image of an organ, which is known in the prior art; 

Figure 13B is a schematic illustration of the trajectory of the 
imaging tip of the catheter of the system of Figure 13A, inside an artery of 
the patient; 

Figure 14 is a schematic illustration of an ECG of a patient; 



-19- 



WO 02/064011 



PCT/1L02/00108 



Figure 15A is a schematic illustration of a system, constructed 
and operative in accordance with another embodiment of the disclosed 
technique; 

Figure 15B is a schematic illustration of trajectories of the tip of 
the imaging catheter of the system of Figure 15A, respective of different 
activity-states of the ECG of Figure 14; 

Figure 16A is a schematic illustration of the system of Figure 
15A, further adapted for surgical procedure; 

Figure 16B is a schematic illustration of a graphical user 
interface (GUI), constructed and operative in accordance with a further 
embodiment of the disclosed technique; 

Figure 16C is a schematic illustration of a GUI, constructed and 
operative in accordance with another embodiment of the disclosed 
technique; 

Figure 16D is a schematic illustration of a process of 
reconstructing a three-dimensional organ motion dependent image 
sequence, and superimposing additional visual data thereon; 

Figure 17 is a schematic illustration of an internal three- 
dimensional navigation image of an inspected organ, constructed and 
operative in accordance with a further embodiment of the disclosed 
technique; 

Figure 18 is a schematic illustration of an ECG coordinated 
display of an inspected organ, constructed and operative in accordance 
with another embodiment of the disclosed technique; 

Figure 19A is a schematic illustration of a GUI, constructed and 
operative in accordance with a further embodiment of the disclosed 
technique; 

Figure 19B is a schematic illustration of a GUI, constructed and 
operative in accordance with another embodiment of the disclosed 
technique; 
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Figure 20 is a schematic illustration of a GUI, constructed and 
operative in accordance with a further embodiment of the disclosed 
technique; 

Figure 21 is a schematic illustration of a trajectory, corrected 
according to the location and orientation of the tip of the surgical tool of the 
system of Figure 16A, in accordance with another embodiment of the 
disclosed technique; 

Figure 22 is a schematic illustration of a method for operating 
the system of Figure 15A, operative in accordance with a further 
embodiment of the disclosed technique; 

Figure 23A is an illustration of an artery, having a plurality of 
occluded regions; 

Figure 23B is a cross-sectional view of a selected region of the 
artery of Figure 23A; 

Figure 23C is a schematic illustration of a representation of the 
artery of Figure 23B in a GUI, operative in accordance with another 
embodiment of the disclosed technique; 

Figure 24 is a schematic illustration of a method for operating 
the GUI of Figure 23C, operative in accordance with a further embodiment 
of the disclosed technique; 

Figure 25A is a schematic illustration of the images of a vessel 
at three different activity-states; 

Figure 25B is a schematic illustration of one of the two- 
dimensional images acquired at one activity-state, translated to another 
activity-state, in accordance with another embodiment of the disclosed 
technique; 

Figure 25C is a schematic illustration of the image of the vessel 
of Figure 25A at one of the activity-states, reconstructed in accordance 
with the embodiment of Figure 25B, from the two-dimensional images of 
the vessel, which are detected at the other two activity-states; 
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Figure 25D is a schematic illustration of the image of the vessel 
of Figure 25A at another activity-state, reconstructed in accordance with 
the embodiment of Figure 25B, from the two-dimensional images of the 
vessel, which are detected at the other two activity-states; 

Figure 26 is a schematic illustration of a method for 
reconstructing a three-dimensional image, operative according to a further 
embodiment of the disclosed technique; 

Figure 27A is an illustration of a section of a vessel, which 
includes a plurality of branches; and 

Figure 27B is a schematic illustration of a GUI, constructed and 
operative according to another embodiment of the disclosed technique. 
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DETAILED DESCRIPTION OF THE EMBODIMENTS 

The disclosed technique overcomes the disadvantages of the 
prior art by providing methods and systems for constructing and displaying 
three-dimensional images of moving organs, synchronously with the 
movement of these organs and synchronously with an invasive tool, such 
as a catheter. According to an embodiment, the three-dimensional images 
and the presentation of the invasive tool, all reside within a single 
coordinate system, and no registration of a plurality of coordinate systems 
is required. 

According to one aspect of the disclosed technique there is 
provided a pseudo real time imaging system, for minimal invasive surgery. 
This system includes a two-dimensional image acquisition system, a 
medical positioning system (MPS) which is basically a location and 
orientation detection system, a specific organ monitor and an image 
processing system. The location and orientation detection system includes 
at least three sensors. The first sensor is mounted on the image detector 
of the two-dimensional image acquisition system. The second sensor is 
mounted on the minimal invasive surgery tool. The third sensor is attached 
to the body of the patient for reference. Attaching the third sensor to the 
body of the patient during all of the procedures of the method of the 
disclosed technique, assures that both the sensor of the image detector 
and the sensor of the surgical tool, as well as additional sensors which are 
attached to further modules of the system of the disclosed technique, 
remain in a single coordinate system at all times. 

The system acquires two-dimensional images at a rate, faster 
than the organ cycle frequency, and preferably equal to the organ cycle 
frequency multiplied by a natural number. The system records each two- 
dimensional image, acquired by the image detector, in association with the 
detected location and orientation thereof, and with the organ timing signal 
reading, as detected by the organ monitor. It is noted that the system 

operates under the assumption that the detected organ is characterized by 
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a cyclic behavior, and that a reading in one cycle is likely to be detected in 
subsequent cycles. 

The imaging system reconstructs a three-dimensional image 
from all of the recorded two-dimensional images, which have the same 
organ timing signal reading (from different cycles). When the 
reconstructed three-dimensional images include sufficient information, the 
system displays a sequence of these three-dimensional images, 
synchronized with a real-time reading of the organ timing signal, thereby 
providing a real-time visualization of the inspected organ. At the same 
time, the system continues to acquire additional two-dimensional images 
and to update and elaborate the existing three-dimensional image. Hence, 
the quality of the displayed sequence of three-dimensional images, 
constantly improves. 

At this point, the physician can insert a minimal invasive surgical 
tool into the body of the patient. The system detects the location and 
orientation of the MPS detector mounted on the surgical tool and super- 
imposes a representation thereof, on the currently displayed three- 
dimensional image. 

The system detects movements of the patient using the MPS 
detector, which is attached to the patient. These movements shift the 
coordinate system of the detected organ relative to the coordinate system 
in which the two-dimensional images were acquired and the three- 
dimensional images are reconstructed. The system utilizes the patient 
MPS reading both for placing all the acquired two-dimensional images in a 
moving coordinate system defined by the location of the inspected organ, 
and for placing and orienting the surgical tool, in that same moving 
coordinate system. 

According to another aspect of the disclosed technique, by 
removing the surgical tool, the system can be used merely as a pseudo 
real-time imaging system, used for diagnostic purposes. According to a 
further aspect of the disclosed technique, the system displays the three- 
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dimensional image sequence, using semi transparent stereoscopic 
goggles, which have an MPS sensor attached thereto. The system uses 
the goggles MPS sensor to set the location and orientation of the goggles, 
within the coordinate system of the patient. Accordingly, the system 
produces a visualization of the three-dimensional image sequence, which 
is perceived by the physician, as being located at the same place of the 
organ. 

The following is an example of a system and method for image 
acquisition, playback and minimal invasive surgery, where the inspected 
organ is a heart. Reference is now made to Figure 1 , which is a schematic 
illustration of a multi functional three-dimensional imaging system, 
generally referenced 100, constructed and operative in accordance with an 
embodiment of the disclosed technique. In the example set forth in Figure 
1, system 100 is adapted for producing a three-dimensional image 
sequence of the heart and playing it in real time synchronicity, with the 
motion of the heart. 

Three-dimensional imaging system 100 includes, a main 
computer 102, a two-dimensional image acquisition device 104, an ECG 
monitor 106, a medical positioning system (MPS) 108, a frame grabber 
110, a digital three-dimensional image reconstructor (D3DR) 112, an 
adaptive volumetric database (AVDB) 114, a superimposing processor 
116, a surgical tool 120, a plurality of MPS sensors 162^ 162 2 and 162 N , 
and a display 130. 

Two-dimensional image acquisition device 104 provides a two- 
dimensional image of an area within the body of the patient. Two- 
dimensional image acquisition device 104 can be of any type known in the 
art, such as ultra-sound, inner-vascular ultra-sound, X-ray, computerized 
tomography, nuclear magnetic resonance, positron-emission tomography, 
single-photon-emission tomography, and the like. 

Two-dimensional image acquisition device 104 includes an 
image transducer 118. ECG-monitor continuously detects an electrical 
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timing signal of the heart during inspection or surgery procedure, by 
employing a plurality of ECG-electrodes 128. 

Main computer 102 is coupled to ECG monitor 106, MPS system 
108, frame grabber 110, D3DR 112, superimposing processor 116, AVDB 
114 and to display 130. Two-dimensional image acquisition device 104 is 
coupled to frame grabber 110. MPS system 108 includes an MPS 
transmitter (not shown) and MPS sensors 162 1; 162 2 and 162 N . 

Reference is further made to Figure 2C, which is a schematic 
illustration in detail of MPS system 108, constructed and operative in 
accordance with another embodiment of the disclosed technique. MPS 
system 108 includes a location and orientation processor 150, a 
transmitter interface 152, a plurality of look-up table units 154 1( 154 2 and 
154 3 , a plurality of digital to analog converters (DAC) 156^ 156 2 and 156 3 , 
an amplifier 158, a transmitter 160, a plurality of MPS sensors 162l 162 2 , 
162 3 and 162 N , a plurality of analog to digital converters (ADC) 164!, 164 2 , 
164 3 and 164 N and a sensor interface 166. 

Transmitter interface 152 is coupled to location and orientation 
processor 150 and to look-up table units 154!, 154 2 and 154 3 . DAC units 
156i, 156 2 and 156 3 are coupled to a respective one of look-up table units 
154!, 154 2 and 154 3 and to amplifier 158. Amplifier 158 is further coupled 
to transmitter 160. Transmitter 160 is also marked TX. MPS sensors 162 1? 
162 2 , 162 3 and 162 N are further marked RX 1( RX 2 , RX 3 and RX N , 
respectively. 

Analog to digital converters (ADC) 164^ 164 2 , 164 3 and 164 N are 
respectively coupled to sensors 162^ 162 2 , 162 3 and 162 N and to sensor 
interface 166. Sensor interface 166 is further coupled to location and 
orientation processor 1 50. 

Each of look-up table units 154 1( 154 2 and 154 3 produces a 
cyclic sequence of numbers and provides it to the respective DAC unit 
156i, 156 2 and 156 3 , which in turn translates it to a respective analog 
signal. Each of the analog signals is respective of a different spatial axis. 
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In the present example, look-up table 154i and DAC unit 156! produce a 
signal for the X axis, look-up table 154 2 and DAC unit 156 2 produce a 
signal for the Y axis and look-up table 154 3 and DAC unit 156 3 produce a 
signal for the Z axis. 

DAC units 156!, 156 2 and 156 3 provide their respective analog 
signals to amplifier 158, which amplifies and provides the amplified signals 
to transmitter 160. Transmitter 160 provides a multiple axis 
electromagnetic field, which can be detected by MPS sensors 162^ 162 2 , 
162 3 and 162 N . Each of MPS sensors 162 1t 162 2 , 162 3 and 162 N detects 
an electromagnetic field, produces a respective electrical analog signal 
and provides it to the respective ADC unit 164^ 164 2 , 164 3 and 164 N 
coupled thereto. Each of the ADC units 164!, 164 2 , 164 3 and 164 N digitizes 
the analog signal fed thereto, converts it to a sequence of numbers and 
provides it to sensor interface 166, which in turn provides it to location and 
orientation processor 150. 

Location and orientation processor 150 analyzes the received 
sequences of numbers, thereby determining the location and orientation of 
each of the MPS sensors 162i, 162 2 , 162 3 and 162 N . Location and 
orientation processor 150 further determines distortion events and updates 
look-up tables 154^ 154 2 and 154 3 , accordingly. 

Referring back to Figure 1, image transducer 118 detects a 
plurality of two-dimensional images, each representing a slice of the 
inspected organ (i.e., the heart). Each of these two-dimensional images 
has a different spatial location and orientation. 

Frame grabber 110 grabs each detected two-dimensional image 
and provides it to main computer 102. MPS system 108 receives and 
processes data related to the location and orientation of surgical tool 120 
via MPS sensor 162! and processes data related to the location and 
orientation of image transducer 1 18 via MPS sensor 162 2 . 

MPS system 108 further receives and processes data related to 
the location and orientation of the body of a patient, via MPS sensor 162 N . 
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It is noted that MPS sensor 162 N is used as reference in case the patient 
moves. MPS sensor 162 N is generally attached to an inspected area of a 
patient body (reference 140). It is noted that MPS system 108 can include 
additional MPS sensors, to be used as further references, thereby 
enhancing the performance of system 100. It is noted however that other 
methods for assigning a reference point can be used such as initial 
referencing between all of the MPS sensors and strapping the patient 
during the entire procedure, analyzing the acquired images and identifying 
a recurring visual point or section therein for each of the MPS sensors 
other than the one for the transducer, and the like. 

MPS system 108 produces predetermined electromagnetic fields 
using the MPS transmitter. Each of the MPS sensors 162 17 162 2 and 162 N 
includes electromagnetic field detection elements, such as coils, for 
detecting the electromagnetic fields produced by MPS system 108. 

MPS system 108 processes the detected electromagnetic fields 
and provides an indication of the three-dimensional location and 
orientation of MPS sensors 162^ 162 2 and 162 N . Hence, MPS system 108 
is operative to determine the location and orientation of image transducer 
118, surgical tool 120 and a selected point on the body of the patient. 

The location and orientation of each of the captured two- 
dimensional images are directly derived from the location and orientation 
of image transducer 118. Hence, by determining the location and 
orientation of MPS sensor 162 2 , MPS system 108 can determine the 
location and orientation of each of the two-dimensional images captured 
by image transducer 118. 

ECG monitor 106 obtains and represents an electrical timing 
signal (ECG - electrocardiogram) of the inspected heart. It is noted that 
ECG is a heart timing signal, which includes ECG cycles and represents 
the propagation of electrical currents through specific regions of the heart. 
The duration of an ECG cycle (or cardiac cycle) is defined as the time 
between two subsequent heart contractions. ECG is detected using at 
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least two ECG-electrodes, which are placed on selected areas of the body 
ot the patient (e.g., the arms, legs, chest, abdomen, and the like). 

ECG-electrodes 128 continuously obtain an electrical signal from 
the heart and provide this signal to ECG monitor 106. ECG monitor 106 
amplifies the received electrical signal, produces a graphic line tracing the 
electrical activity of the heart, as a function of the time, and provides this 
data in digital format to main computer 102. 

Main computer 102 receives each of the two-dimensional 
images, the respective three-dimensional location and orientation of that 
specific two-dimensional image and the organ timing signal of the heart at 
the time the image was captured. Main computer 102 can further receive 
the three-dimensional location and orientation of surgical tool 120. Main 
computer 102 associates each detected two-dimensional image, with the 
location and orientation information and the heart-timing signal. 

When the surgical tool 120 is located within the inspected organ, 
a two-dimensional image can include a sliced representation of a portion 
thereof. Main computer 102 receives the location and orientation of MPS 
sensor 162^ which is attached to the surgical tool and can extrapolate the 
location and orientation of a larger portion of the surgical tool, in case that 
portion of the surgical tool is substantially rigid. Hence, main computer 102 
can determine if that portion of surgical tool 1 20 is located within an area 
of the acquired two-dimensional image. Main computer 102 can discard 
this area, while updating the three-dimensional image, to which the two- 
dimensional image belongs. 

D3DR 112 reconstructs a three-dimensional image from 
captured two-dimensional images, having the same activity-state (e.g., for 
each determined point of the heart timing cycle) and from the three- 
dimensional location and orientation data associated with each of the 
images. 

AVDB 114 contains the reconstructed three-dimensional images 

of the inspected organ, along with the activity-state associated therewith 
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and with the location and orientation of the coordinate system thereof. The 
detected ECG sequence is further used for synchronously playing back 
the three-dimensional images, where every three-dimensional image is 
displayed when the activity-state associated therewith is substantially 
equal to the real-time detected activity-state of the inspected organ. 

In case surgical tool 120 is inserted in the heart, superimposing 
processor 1 1 6 can add the three-dimensional location and orientation of 
surgical tool 120 to the reconstructed three-dimensional image. 
Alternatively, main computer 102 can extrapolate the shape of surgical tool 
120 in the coordinate system of the reconstructed three-dimensional 
image. 

Display 130 presents a three-dimensional motion picture of the 
inspected organ in synchrony therewith, which can be considered a 
pseudo real-time simulation thereof. It is noted that main computer 102 
can determine the display reference coordinate system to be any of the 
following: 

□ The coordinate system of the patient, where the body of the 
patient is still and the inspected organ and the surgical tool, 
move. 

□ The coordinate system of the inspected organ, where the 
inspected organ is still, and surgical tool and the rest of 
body of the patient, move. It is noted that this viewing 
coordinate system can be extremely useful in cases where 
the inspected organ exhibits rapid movement. 

□ The coordinate system of the surgical tool, where the 
surgical tool is still, and the inspected organ as well as the 
rest of the body of the patient, move. 

Reference is now made to Figures 2A and 2B. Figure 2A is an 
illustration in perspective of an inner-body radial ultrasound imaging 
system, generally referenced 170, constructed and operative in 

accordance with a further embodiment of the disclosed technique. Figure 
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2B is an illustration in perspective of a plurality of radial two-dimensional 
images of the inner walls of an inspected vessel, generally referenced 190. 

System 170 includes an Inner-body radial image transducer 172, 
a surgical tool (i.e., typically a minimal invasive surgical device) 174, MPS 
sensors 176 and 178, a mounting catheter 180 and a dilation catheter 182. 
It is noted that inner-body radial ultrasound imaging system 170 can be 
replaced with alternative ultrasound systems such as an inner-vascular 
ultrasound system (IVUS) which is discussed in further detail in Figure 12 
herein below, or other types of two-dimensional imaging systems. 

Radial image transducer 172 is mounted on mounting catheter 
180, which is further inserted in dilation catheter 182. MPS sensor 176 is 
located at a tip of mounting catheter 180 adjacent to radial image 
transducer 172. Mounting catheter 180 is inserted in dilation catheter 182. 
MPS sensor 178 is located in close proximity to the tip of surgical tool 174. 
Surgical tool 174 is further inserted in dilation catheter 182. 

Radial image transducer 172 detects a plurality of two- 
dimensional images of different areas of the inspected organ (such as two- 
dimensional images 190A, 190B, 190C, 190D, 190E and 190F (Figure 
2B). MPS system 108 (Figure 1) detects the location and orientation of 
radial image transducer 172, using sensor 176. MPS system 108 (Figure 
1) further detects the location and orientation of surgical tool 174, using 
sensor 178. The location and orientation of two-dimensional images 190A, 
190B, 190C, 190D, 190E and 190F (Figure 2B) are directly derived from 
the location and orientation of the transducer 172. 

As can be seen in Figure 2B, each of the detected two- 
dimensional images 190A, 190B, 190C, 190D, 190E and 190F is a two- 
dimensional representation of a different peripheral portion of the 
inspected area within the inspected organ and its vicinity. Radial image 
transducer 172 provides the detected two-dimensional images 190A, 
190B, 190C, 190D, 190E and 190F to two-dimensional image acquisition 
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device 104 (Figure 1). The System 100 associates each two-dimensional 
image, with the location and orientation thereof. 

Reference is now made to Figure 3, which is a schematic 
illustration of a two-dimensional image, generally referenced 190, in a 
given coordinate system, generally referenced 186. Figure 3 is mainly 
used for visualizing the terms "location" and "orientation" of the two- 
dimensional image 190 in coordinate system 186. 

The location and orientation of each two-dimensional image 190 
are determined in the coordinate system 186 (X, Y and Z). System 100 
determines a selected point in each captured two-dimensional image, 
which is to be the reference point for that image. In the example set forth 
in Figure 3, the center of the image is determined to be the reference 
location point thereof. A unit vector extending from that point, 
perpendicular to the plane of that image determines the orientation of that 
image. 

Each detected two-dimensional image 190 is taken in a specific 
location (X', Y' and T) and a specific orientation (angles □, □ and □). 
Vector 192 extends from a selected point 194 of the image 190. The 
coordinates of this point X', Y' and T determine the specific three- 
dimensional location of the image 190 in the coordinate system 186. 
Angles □, □ and □ are the angles between the vector 192 and each of the 
axes X, Y and Z, accordingly. Thereby, vector 192 determines the specific 
three-dimensional orientation of the image 190 in coordinate system 186. 

Reference is now made to Figure 4, which is an illustration in 
perspective of a plurality of two-dimensional images, generally referenced 
190, and an organ timing signal, generally referenced 188. In the example 
set forth in Figure 4, the organ timing signal is an ECG signal. 

The ECG signal can be used for synchronizing the detection 
procedure of two-dimensional images 190A, 190B, 190C, 190D, 190E, 
190F, 190G, 190H, 1901, 190J, 190K, 190L, 190M, 190N, 190O, 190P, 
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190Q, 190R and 190S, where each image is taken at a predetermined 
position in the organ timing signal. Two-dimensional images 190A, 190B, 
190C, 190D, 190E, 190F, 190G, 190H, 1901, 190J, 190K, 190L, 190M, 
190N, 190O, 190P, 190Q, 190R and 190S are detected at predefined 
points in time to, t 1( t 2> t 3l t 4 , t 5 , t 6 , t 7 , t 8 , t 9 , t 10 , t 11f t 12 , t 13 , t 14 , t 15 , t 16 , t 17 and 
t 18 , respectively. T denotes the cycle duration of ECG signal 188 (e.g., the 
time interval between the time points t 0 andt 8 ). Each point p 0 , Pi, p 2l P3» P4> 
p 5 , p 6 , p 7 , p 8 , Pg, P10, Pn, P121 Pia, Pi4, Pis, Pie, P17 and p 18 denotes a 
specific position on the ECG timing signal and is associated with specific 
activity-state of the heart. 

In this example, two-dimensional images are detected 
continuously at a rate of eight images per ECG cycle into predetermined 
points in each heart cycle. Each point p 0 , Pi, P2, P3, P4» Ps> P6 and py 
denotes a specific position on the first ECG cycle, each point p 8 , p 9 , Pio, 
Pn> P12, P13, P14 and P15 denotes a specific position on the second ECG 
cycle, and the like. Points p 8 and p 16 have the same specific position on 
the ECG timing signal, as point p 0 , and hence are associated with the 
same activity-state. Points p 9 and p 17 have the same specific position on 
the ECG timing signal, as point p 1t and hence are associated with the 
same activity-state. Points p 10 and p 18 have the same specific position on 
the ECG timing signal, as point p 2 , and hence are associated with the 
same activity-state. Thus, each detected two-dimensional image is 
associated with a specific activity-state of the heart. 

Reference is now made to Figures 5A, 5B, 5C and 5D. Figure 
5A is a schematic illustration of a plurality of three-dimensional volumes, 
generally referenced 200, according to another embodiment of the 
disclosed technique. Figure 5B is a schematic illustration of some of the 
three-dimensional volumes of Figure 5 A, at a later stage of image 
reconstruction. Figure 5C is a schematic illustration of a selected three- 
dimensional volume of Figure 5A, going through a procedure of image 
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updating. Figure 5D is a schematic illustration of a two-dimensional image, 
which includes foreign object information. 

With reference to Figure 5A, each of the three-dimensional 
volumes 200 is associated with a selected one of the specific positions in 
the organ timing signal cycle, and hence is associated with the respective 
activity-state. In the present example, three-dimensional volumes 200A, 
200B, 200C and 200D are associated with organ timing signal cycle 
locations T, l AT t V2I and %T, respectively. 

Each of the three-dimensional volumes 200A, 200B, 200C and 
200D is used for reconstructing a three-dimensional image for a selected 
location in the organ timing signal cycle, and hence for the respective 
activity-state. Main computer 102 (Figure 1) sorts the two-dimensional 
images according to the timing position of the image on the ECG signal 
(i.e., a specific activity-state). 

In the present example, volume 200A includes two-dimensional 
images 190A, 1901 and 190Q (Figure 4), which were detected at time 
points to, t 8 and t 16 , respectively. The position in the organ timing signal 
cycle of these images is T. Volume 200B includes two-dimensional images 
190C, 190K and 190S (Figure 4), which were detected at time points t 2 , t 10 
and t 18 , respectively. The position in the organ timing signal cycle of these 
images is l A T. Volume 200C includes two-dimensional images 190E and 
190M (Figure 4), which were detected at time points t 4 and t 12 , 
respectively. The position in the organ timing signal cycle of these images 
is Vi T. Volume 200D includes two-dimensional images 190G and 190O 
(Figure 4), which were detected at time points t 6 and t 14 , respectively. The 
position in the organ timing signal cycle of these images is % T. 

At this point, volume 200A contains information relating to the 
two-dimensional images that were stored therein, while portions of volume 
200A remain at zero value, since no two-dimensional image is related 
thereto. D3DR 112 analyzes the content of three-dimensional volume 
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200A and attempts to determine the value of some of these zero value 
portions, for example, by means of extrapolation. With reference to Figure 
5B, D3DR 112 (Figure 1) reconstructs image 330A within three- 
dimensional volume 200A. Similarly, D3DR 112 reconstructs image 330C 
within three-dimensional volume 200C. 

System 100 (Figure 1) updates the three-dimensional image 
330A in real time. Main computer 102 (Figure 1) continuously receives 
two-dimensional images, associated with a location and orientation thereof 
and an organ activity-state. Main computer 102 (Figure 1) provides each of 
these two-dimensional images to D3DR 112 (Figure 1) together with the 
three-dimensional volume, associated with the same organ activity-state. 
D3DR 112 updates the three-dimensional volume according to the values 
of the new two-dimensional images. 

The update procedure can be performed in many ways. 
According to one aspect of the disclosed technique, a new value in a 
selected three-dimensional pixel (voxel) replaces an old value. According 
to another aspect of the disclosed technique, an updated voxel value 
includes a combination (linear or otherwise) of the old voxel value (i.e., 
which already exists in the three- dimensional volume) and the newly 
acquired value (i.e., received from the two-dimensional image). It is noted 
that system 100 can operate either using polygonal or voxel 
representations. 

According to a further aspect of the disclosed technique, each of 
the voxels in the three-dimensional volume includes various attributes 
such as if the current value thereof, was provided from an acquired image, 
or was calculated in the process of reconstructing the three-dimensional 
image, by means of extrapolation. In this case, a newly acquired value is 
preferred over a calculated one. With reference to Figure 5C, D3DR 112 
receives a new two-dimensional image 190Y, which is associated with an 
organ activity state of t=T. D3DR 112 updates the respective three- 
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dimensional volume 200A and the image therein 330A, thereby producing 
an updated image 330A UPDAT ed- 

In case where a surgical tool 120 (Figure 1) is inserted in the 
inspected organ, the system 100 excludes a fragment of the two- 
dimensional image, which contains a representation of the surgical tool 
120. Main computer 102 (Figure 1) modifies the two-dimensional image by 
excluding these fragments (e.g. by introducing null values to those 
fragments). D3DR 112 analyzes the modified two-dimensional image and 
does not update the respective portions in the respective three- 
dimensional volume. 

System 100 incorporates the ability to update the three- 
dimensional image sequence of the inspected object, in real time, even in 
the presence of foreign objects such as surgical tool 174 (Figure 2A). 
According to an embodiment of the disclosed technique, main computer 
102 can determine according to the location and orientation of an acquired 
image and of surgical tool 174, if the surgical tool was included in the slice 
represented by the acquired image. With reference to Figure 5D, two- 
dimensional image 190Z incorporates a small section 198, which is a 
representation of a portion of surgical tool 120, as determined from the 
location and orientation of MPS sensor 162^ Two-dimensional image 
190Z and section 198 define a section 199, in which section 198 is 
excluded from two-dimensional image 190Z. According to real-time 
updating procedure of the three-dimensional image sequence which was 
described in connection with Figure 5D, system 100 updates only section 
199 to the respective three-dimensional image. Hence, when the surgical 
tool is removed from the body of the patient, it leaves no traces in the 
reconstructed three-dimensional images. 

It is noted that each ECG cycle consists of a period of relaxation, 
named a diastole followed by a period of contraction named a systole. 
Duration of the ECG cycle is defined as a time between two subsequent 

heart contractions. According to a further embodiment, the ECG cycle is 
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evenly divided by N, where N denotes the number of three-dimensional 
images in the final image sequence. 

Reference is now made to Figure 6, which is a schematic 
illustration of a method for operating the three-dimensional imaging 
system 100, operative in accordance with a further embodiment of the 
disclosed technique. In procedure 230, the timing signal of an inspected 
organ is detected. The detection is performed by a medical monitoring 
device, which is selected according to the inspected organ. For example, if 
the inspected organs are blood vessels of the heart, then the medical 
monitoring device is an ECG monitor. If the inspected organs are the 
lungs, then the medical device is a respiratory rate monitor. Special 
devices can be constructed for detecting the movement of the eye lid, the 
eye, and the like. For example, an MPS sensor can be attached to the eye 
lid for detecting the movement thereof. With reference to Figure 1 , ECG 
monitor 106 detects the organ timing signal through ECG-electrodes 128. 

In procedure 232, a plurality of two-dimensional images of the 
inspected organ is detected. With reference to Figure 1 , two-dimensional 
image acquisition device 104 detects a plurality of two-dimensional images 
of the inspected organ through image transducer 118. 

In procedure 234, the three-dimensional location and orientation 
of the image detector is detected. With reference to Figure 1, MPS system 
108 detects the three-dimensional location and orientation of the image 
detector using MPS sensor 162 2 , mounted thereon. 

In procedure 236, each detected two-dimensional image is 
associated with the location and orientation information thereof and the 
organ timing signal at the time the two-dimensional image was taken. With 
reference to Figure 1, main computer 102 receives the ECG signal, the 
acquired two-dimensional images and the location and orientation of each 
two-dimensional image. Main computer 102 associates each detected 
image with the location and orientation information thereof and with the 
organ-timing signal. 
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In procedure 238, the location and orientation of a surgical tool 
are detected. With reference to Figure 1, MPS system 108 detects the 
location and orientation of surgical tool 120, via MPS sensor 162 v 

In procedure 240, the two-dimensional images are modified by 
discarding a portion thereof, which represents the surgical tool. It is noted 
that two-dimensional images which are located in planes which do not 
intersect the surgical tool, do not include any image respective thereof and 
hence remain unchanged. With reference to Figures 1 and 5D, main 
computer 102 estimates the portion within an acquired two-dimensional 
image, such as two-dimensional image 190Z, that might include a 
representation of the image of surgical tool 120. Main computer 102 
performs that estimation according to the detected location and orientation 
of surgical tool 120. Main computer 102 determines a three-dimensional 
space, which is occupied by surgical tool 120, according to the information 
which MPS sensor ^62 1 acquires and according to data respective of the 
physical dimensions of surgical tool 120. Main computer 102 calculates an 
intersection area (e.g., portion 198 as illustrated in Figure 5D), in which an 
acquired two-dimensional image (e.g., reference 190Z in Figure 5D) and 
that three-dimensional space intersect. Main computer 102 discards that 
intersection area for example, by changing the values thereof to null 
values. Discarding of the image of surgical tool 120 from the two- 
dimensional images, is necessary in order to reconstruct a three- 
dimensional image of the inspected organ, free of artifacts such as the 
image of surgical tool 120. 

In procedure 242, a three-dimensional image is reconstructed. 
The reconstruction includes three procedures. The first procedure is 
sorting the two-dimensional images into groups, according to their 
respective timing position (i.e., activity-state) within the organ timing signal. 
With reference to Figure 1 main computer 102 sorts the two-dimensional 
images according to the image timing position in the organ timing signal 
cycle. 
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The second procedure is the placing of all of the two- 
dimensional images of a selected group in a three-dimensional virtual 
volume (such as a three-dimensional matrix), according to their respective 
location and orientation. With reference to Figure 1, main computer 102 
stores each two-dimensional image in a selected one of the three- 
dimensional virtual volumes 200 (Figure 5A) within adaptive volumetric 
database 114. 

The third procedure is filling the missing parts in the three- 
dimensional virtual volumes, for example, by means of interpolation. With 
reference to Figure 1, D3DR 112 reconstructs a three-dimensional image 
in each of the three-dimensional virtual volumes 200 (Figure 5B), from the 
two-dimensional images stored therein. 

In procedure 244, a three-dimensional image is selected 
according to the organ timing signal detected in procedure 230. With 
reference to Figures 1 and 4, ECG monitor 106 detects the organ timing 
signal 188 of the inspected organ via ECG-electrodes 128. Main computer 
102 selects three-dimensional images according to a real time detected 
organ timing signal. The selected three-dimensional image has to be 
associated with the position in the organ timing signal cycle, as the 
position of the real time detected organ timing signal cycle. 

In procedure 246, a representation of the surgical tool is added 
to the selected three-dimensional image. With reference to Figure 1, MPS 
sensor 162i detects the location and orientation of surgical tool 120. 
Superimposing processor 116 adds a representation (e.g., a symbol) of 
surgical tool 120, to the selected three-dimensional image. Superimposing 
processor 116 adds the representation according to the location and 
orientation of surgical tool 120, which MPS sensor 162i detects in 
procedure 238. Since the location and orientation of the surgical tool and 
the location and orientation of the acquired images, are all detected using 
the same MPS system, they all reside in a single coordinate system and 
hence do not have to be correlated with one another. 
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In procedure 248, the selected three-dimensional image is 
displayed. With reference to Figures 1 and 8, display 130 displays the 
selected three-dimensional images in a sequence, according to the real 
time detected organ timing signal cycle. For example, the operator can 
view a video of the heart of the patient, which corresponds to the real time 
detected heartbeat of the patient and at the same time, hear this heartbeat 
through a stethoscope. 

Reference is now made to Figures 7A and 7B. Figure 7A is a 
schematic illustration of a real-time three-dimensional display playback 
system, generally referenced 270, constructed and operative in 
accordance with another embodiment of the disclosed technique. Figure 
7B is a schematic illustration of the goggles of Figure 7A, displaying a 
three-dimensional image of the heart of a patient. 

With reference to Figure 7A, system 270 includes a 
superimposing processor 272, an adaptive volumetric database (AVDB) 
274, an ECG monitor 278, a display 284, a synchronization processor 286, 
a medical positioning system (MPS) 288, a dilation catheter 280 and a 
plurality of MPS sensors 294, 296 and 298. Display 284 includes a 
renderer 276 and goggles 282. A surgical tool 290 is inserted into dilation 
catheter 280. 

Superimposing processor 272 is coupled to AVDB 274, renderer 
276 and to MPS system 288. Renderer 276 is further coupled AVDB 274 
and to goggles 282. MPS system 288 is further coupled to dilation catheter 
280, renderer 276 and to MPS sensors 294, 296 and 298. Synchronization 
processor 286 is coupled to AVDB 274 and to ECG monitor 278. 

ECG monitor 278 detects the organ timing signal of the 
inspected organ and provides this signal to synchronization processor 286. 
The detected organ timing signal is used for synchronizing a sequence of 
the three-dimensional images with the movement of the inspected heart. 

Synchronization processor 286 analyzes the ECG signal, and 
determines activity-states therein. Synchronization processor 286 provides 
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a retrieval command to AVDB 274, to retrieve an image record, according 
to the currently detected activity-state. 

AVDB 274 contains a sequence of three-dimensional images of 
the inspected organ, along with an activity-state associated therewith and 
with the location and orientation of the coordinate system thereof. It is 
noted that this sequence of the three-dimensional images can be acquired 
using system 100 (Figure 1) or any other system for acquiring three- 
dimensional images (e.g., MRI, X-rays, and the like). 

AVDB 274 selects a three-dimensional image of the organ, 
which is associated with the specific activity-state according to the 
received retrieval command. This three-dimensional image can be 
rendered and displayed as is, in synchrony with the organ timing signal. In 
the example, where the inspected organ is the heart, the physician is 
presented with an image sequence, which is real-time synchronized with 
the ECG signal. The physician, as she uses her stethoscope to hear the 
heart beats, can see a moving visual representation of the heart, at the 
same time. 

Renderer 276 can render the three-dimensional image 
according to reference coordinates of surgical tool 290, reference 
coordinates of the inspected organ, or reference coordinates of the body 
of the patient. The selected reference coordinates define a stationary 
reference coordinate system, in which all the other objects may move. 

For example, if the coordinates of surgical tool 290 are selected 
as reference, then renderer 276 renders the three-dimensional image so 
that the surgical tool is stationary and the heart moves relative thereto. 
Accordingly, when the physician moves surgical tool 290 relative to the 
inspected organ, she observes a stationary representation of surgical tool 
290, while the inspected organ exhibits movement due to the motion of the 
inspected organ relative to the representation of surgical tool 290. 

On the contrary, if the coordinates of the inspected organ are 
selected as reference, then renderer 276 renders the three-dimensional 
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image so that the inspected organ is stationary and surgical tool 290 
moves relative thereto. Accordingly, when the physician moves surgical 
tool 290 relative to the inspected organ, she observes a stationary image 
of the inspected organ, while surgical tool 290 exhibits movement due to 
the motion of the representation or surgical tool 290 relative to the 
inspected organ. 

MPS system 288 includes an MPS transmitter (not shown) and 
MPS sensors 294, 296 and 298. MPS system 288 determines the location 
and orientation of surgical tool 290, using sensor 294 mounted thereon. 
MPS system 288 determines the location and orientation of the point of 
view of the user, using MPS sensor 296 (Figure 7B), mounted on goggles 
282. MPS system 288 determines the location and orientation of the body 
of the patient using MPS sensor 298, attached thereto. 

Superimposing processor 272 receives the selected three- 
dimensional image of the heart from AVDB 274. Superimposing processor 
272 further receives parameters related to the location and orientation of 
surgical tool 290 and parameters related to the location and orientation of 
reference points on the body of the patient, from MPS system 288. 

Superimposing processor 272 uses the location and orientation 
of the reference points to align the coordinate system of the three- 
dimensional images with the coordinate system of surgical tool 290. 
Superimposing processor 272 adds a representation of surgical tool 290 to 
the three-dimensional image of the heart and provides this image to 
renderer 276. 

Renderer 276 receives parameters related to the location and 
orientation of goggles 282 and the parameters related to the location and 
orientation of the reference points of the body of the patient, from MPS 
system 288. Renderer 276 uses these parameters to determine a viewing 
plane, and renders the three-dimensional images to that viewing plane. 
Renderer 276 provides the rendered images to goggles 282. 
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Goggles 282 (Figure 7B) are preferably see-through, so that 
they are semi-transparent, in a way that the physician can actually see the 
body of the patient as well as an image projected on the goggle screens. 
System 270 (Figure 7A) determines a projection plane on the body of the 
patient, according to the location and orientation of the body of the patient 
and of goggles 282. System 270 displays the three-dimensional image 
sequence using goggles 282 so that it is perceived to be within the body of 
the patient, as actually seen by the physician through goggles 282. 

Reference is now made to Figure 8, which is an illustration in 
perspective of a cyclical sequence of three-dimensional images, according 
to a further embodiment of the disclosed technique. The sequence is 
presented, image by image to a user, so as to produce an illusion of a 
moving image. The intermediate presented three-dimensional image is 
selected according to a real-time detected specific location in the organ 
timing signal cycle. 

With reference to Figure 7A, AVDB 274 selects three- 
dimensional images continuously, for example, at a rate of eight images 
per each heart cycle. Synchronization processor 286 provides a retrieval 
command to AVDB 274, according to the currently detected specific 
position in the organ timing signal cycle. AVDB 274 retrieves three- 
dimensional images 330A, 330B, 330C, 330D and 330H according to 
selected points t^O, t 1= 1/8T, t2=2/8T, t 3 =3/8T, t 4 =4/8T and t 7 =7/8T within 
the heart timing signal (Figure 4), respectively. As stated above, each 
three-dimensional image 330 is associated with the specific activity-state 
of the heart. Hence, playing images 330A, 330B, 330C, 330D and 330H in 
cyclic sequence provides a pseudo-realistic illustration of the motion of the 
organ (i.e., due to the repetitive nature of the periodic cardiac motion). 

Reference is now made to Figure 9, which is a schematic 
illustration of a superimposing process, operative in accordance with 
another embodiment of the disclosed technique. The system 270 (Figure 
7A) introduces a representation of the currently used surgical tool 328 in 
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each selected image, such as image 330A. This representation can either 
be a minimal one (e.g., in the form of a cursor) or an elaborated one which 
provides pseudo-realistic visualization of that surgical tool. 

The location and orientation of three-dimensional image 330A 
are determined in a coordinate system 326 (X, Y and Z). Similarly, the 
location and orientation of a MPS sensor 318, and hence the location and 
orientation of a surgical tool 328 are also determined in the coordinate 
system 326 (X, Y and Z). Accordingly, a real-time representation of 
surgical tool 328 can be added to three-dimensional image 330A. With 
reference to Figure 7A, superimposing processor 272 adds the 
representation of surgical tool 328 to the selected three-dimensional 
image 330A, which was reconstructed in thee-dimensional volume 200A. It 
is noted that the surgical tool is a conventional tool, such as clamp, laser 
cutter, brush, catheter, stent, balloon, pace maker electrode, solution 
dispensing unit, neuron electrode, substance collection unit, surgical 
delivery tool (e.g., for delivering genes, drugs, devices and the like), and 
the like. For example, a device delivery tool can be a medical tool for 
delivery of a medical device, such as a permanent stent, a removable 
stent, and the like, to the body of the patient. 

The disclosed technique allows the physician to operate on a 
dynamically moving object such as the heart, with a real-time 
representation surgical tool that she is using. Reference is now made to 
Figure 10, which is a schematic illustration of a method for operating 
system 270, operative in accordance with a further embodiment of the 
disclosed technique. In procedure 300, an organ timing signal of the 
inspected organ is detected. According to the disclosed technique, the 
system 100 (Figure 1) includes a medical monitoring device, which is 
selected according to the inspected organ. Such device detects a time 
dependent signal of the organ, which is associated with an organ 
movement. With reference to Figure 7A, ECG monitor 278 detects the 
heart-timing signal. 
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In procedure 302, a three-dimensional image of the organ (e.g., 
the heart), associated with a selected timing point within the organ timing 
signal is selected. With reference to Figure 7A, AVDB 274 selects the 
three-dimensional image of the organ. 

In procedure 304, the location and orientation of a surgical tool, 
are detected. Detection of the location and orientation of a surgical tool 
can be performed by methods known in the art, such as magnetic fields, 
ultrasound triangulation or radiation, inertial sensor - dead reckoning 
sensor, and the like. With reference to Figure 7A, MPS system 288 
detects the location and orientation of surgical tool 290, using sensor 294 
mounted thereon. 

In procedure 306, a representation of the location and 
orientation of the surgical tool is superimposed on the selected three- 
dimensional image. With reference to Figure 7A, superimposing processor 
272 superimposes parameters related to location and orientation of the 
surgical tool on the selected three-dimensional image. 

In procedure 308, the location and orientation of the point of 
view of the user, are detected. The location and orientation of the point of 
view of the user are derived from the location and orientation of goggles 
282. Parameters of the location and orientation of goggles 282 determine 
a viewing plane of the user. System 270 can determine two adjacent 
viewing planes, one for each LCD element of the goggles (one for each 
eye). With reference to Figure 7A, MPS system 288 detects the location 
and orientation of goggles 282, using sensor 296 mounted thereon. It is 
noted that more than one display unit (i.e., more than one goggles unit) 
can be introduced to the system, employing a different MPS sensor, 
mounted thereon. 

In procedure 310, the selected three-dimensional image is 
rendered according to the location and orientation of the point of view of 
the user. With reference to Figure 7A, renderer 276 renders the selected 
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three-dimensional image according to the location and orientation of the 
point of view. 

In procedure 312, a rendered three-dimensional image 
sequence (i.e., a three-dimensional motion picture) is displayed. The 
three-dimensional motion picture of the inspected organ can be displayed 
on any type of display, monoscopic, stereoscopic or holographic (e.g., a 
video monitor, goggles, holographic generator, and the like). With 
reference to Figure 7A, goggles 282 display a rendered three-dimensional 
image sequence. 

Reference is now made to Figure 11, which is an illustration in 
perspective of an inner-vascular imaging and surgery system, generally 
referenced 350, constructed and operative in accordance with another 
embodiment of the disclosed technique. Inner-vascular imaging and 
surgery system 350 includes an inner-vascular ultrasound system (IVUS) 
transducer 352, a surgical tool (i.e., typically a minimal invasive surgical 
device) 354, MPS sensors 356 and 358, a mounting catheter 360 and a 
dilation catheter 362. IVUS transducer 352 is mounted on mounting 
catheter 360. It is noted that other IVUS devices, such as ones, which 
include rotary acoustic mirrors, are also applicable to this embodiment. 

IVUS transducer 352 produces ultrasound waves and directs 
them at the inner wall of a tubular organ (not shown), covering a surface 
referenced 364. Surface 364 reflects a portion of the ultrasonic waves 
directed thereto. IVUS transducer 352 detects these reflected ultrasonic 
waves and provides a respective signal to an image processing system 
(not shown) coupled thereto. A conventional image processing system 
reconstructs a single three-dimensional image from all of the two- 
dimensional images, according to the location and orientation of each of 
them. According to the disclosed technique, the image processing system 
reconstructs a plurality of three-dimensional images, each for a different 
position in the timing cycle of the organ timing signal. 
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It is noted, that the IVUS is used for imaging the interior of 
coronary arteries during diagnosis, clinical treatment and performing 
research. This system provides a comprehensive and detailed 
understanding of the coronary arteries (or other blood vessels). A 
conventional IVUS detector is, for example, the Ultra-Cross system, 
manufactured by Boston Scientific Scimed or the In-Vision system, 
manufactured by Jomed USA (aka Endosonics) both companies located in 
San-Diego, California USA. These systems are mainly used for slicing 
images of coronary images. 

The disclosed technique provides a novel structure, for 
producing a quantitative model of the blood vessel, using a combination of 
conventional IVUS elements and the unique miniature MPS sensor. Such 
combination shall be referred to as Guided IVUS or GIVUS, in the 
description to follow. According to a further embodiment of the disclosed 
technique, the GIVUS image sequence can be visually stabilized using the 
ECG signal. A selected time point in the ECG signal cycle, determines the 
momentary local blood pressure in the blood vessel, which in turn 
determines the momentary diameter of that blood vessel for that position 
within the cycle. Hence, the visual diameter of the blood vessel can be 
adjusted artificially, by means of image processing, so as to display a 
steady image of the blood vessel during the surgical procedure. 

In general, the new GIVUS system produces a "3D road map" in 
which the surgeon navigates. Other imaging methods can also be used for 
producing such a road map, which can be stored in the volumetric 
database and played back according to the method of the disclosed 
technique, such as 3D ANGIO, real time MRI, and the like. 

Reference is now made to Figure 12, which is a schematic 
illustration of a multi functional two-dimensional imaging system, generally 
referenced 400, constructed and operative in accordance with a further 
embodiment of the disclosed technique. In the example set forth in Figure 
12, system 400 is adapted for producing a two-dimensional image 
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sequence of the heart and playing it in real time in synchrony with the 
motion of the heart. 

Two-dimensional imaging system 400 includes a main computer 
402, a two-dimensional image acquisition device 404, an ECG monitor 
406, a medical positioning system (MPS) 408, a frame grabber 410, an 
image database 414, a superimposing processor 416, a surgical tool 420, 
a plurality of MPS sensors 432 1f 432 2 and 432 N , and a display 430. 

Two-dimensional image acquisition device 404 includes an 
image transducer 418. ECG monitor 406 continuously detects an electrical 
timing signal of the heart during inspection or surgery, by employing a 
plurality of ECG electrodes 428. 

Main computer 402 is coupled to ECG monitor 406, MPS system 
408, frame grabber 410, superimposing processor 416 and to display 430. 
Two-dimensional image acquisition device 404 is coupled to frame 
grabber 410. MPS system 408 includes an MPS transmitter (not shown) 
and MPS sensors 432 1? 432 2 and 432 N . 

System 400 is directed at capturing and playing a two- 
dimensional image sequence of the inspected organ, with a superimposed 
representation of the projection of the surgical tool 420. Transducer 418 
detects a plurality of two-dimensional images of the inspected organ and 
provides them to two-dimensional image acquisition device 404, which 
further transfers them to frame grabber 410. Frame grabber 410 grabs 
each detected two-dimensional image and provides it to main computer 
402, which stores them in image database 414, along with an organ timing 
signal, as received from ECG monitor 406. The images can be used at 
any time to produce a two-dimensional cyclic image sequence of a 
selected plane of the inspected organ. System 400 can synchronize this 
image sequence with a real-time reading of the timing signal of the 
inspected organ, using procedures similar to those described above. 

The example set forth in Figure 12 includes MPS sensor 432 2 , 
which detects the location and orientation of transducer 418 for each of 
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the acquired images and MPS system 408, which determines if all of the 
acquired images reside on the same plane. If not, then MPS system 408 
can indicate to the user a detected deviation from a given plane, either 
visually, audibly or mechanically (e.g., by means of vibration, and the like). 
It is noted that a simpler version of system 400, according to a further 
embodiment, does not include an MPS sensor attached to the transducer. 

MPS sensor 432! detects the location and orientation of surgical 
tool 420. MPS system 408 determines the location and orientation of 
surgical tool 420 and provides this information to main computer 402, 
which in turn provides it to super-imposing processor 416. Superimposing 
processor 416 determines a representation in space, of the surgical tool 
420, derives a projection thereof, onto the plane of the detected images 
and superimposes that projection on each of the images in real time. 
Display 430 displays the superimposed image sequence to the user. 

Superimposing processor 416 can add additional information to 
the super-imposed sequence, such as the location of the surgical tool, 
above or under the viewed plane. For example, portions of the surgical 
tool which are located on one side of the viewed plane shall be indicated 
using red color, portions of the surgical tool which are located on the other 
side of the viewed plane shall be indicated using blue color, and portions 
of the surgical tool which are located on viewed plane shall be indicated 
using red color. It is noted that although two-dimensional system 400 
provides less visual information than system 100 of Figure 1, it requires 
significantly less processing power and storage area and hence can be 
manufactured at considerably lower costs. 

Reference is now made to Figure 14, which is a schematic 
illustration of an ECG of a patient, generally referenced 442. ECG 442 
includes a plurality of activity-states (e.g. ECG cycle phases), such as 
activity-states T 2 and T 3 in each of a plurality of heart cycles 444, 446 
and 448. Applicant has found that the changes in positions of the artery, 
such as positions 70 (Figure 13B), 72 and 74, are due to the heart beat of 
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the patient and that this is the reason for inaccuracy of trajectory 50. Thus, 
the location and orientation of the artery is different at different activity- 
states, during each of the heart cycles 444, 446 and 448. 

For example, at activity-state of each of the heart cycles 444, 
446 and 448, the location and orientation of the artery is represented by an 
artery image at position 70 (Figure 13B). At activity-state T 2 of each of the 
heart cycles 444, 446 and 448, the location and orientation of the artery is 
represented by an artery image at position 72. At activity-state T 3 of each 
of the heart cycles 444, 446 and 448, the location and orientation of the 
artery is represented by an artery image at position 74. Thus, each of the 
points 52, 54, 56, 58, 60, 62, 64, 66 and 68 corresponds to a location and 
orientation of the imaging tip of catheter 12 (Figure 13A), while the artery 
is at a different location and orientation, in a different activity-state of a 
heart cycle. 

For example, point 52 corresponds to activity-state in heart 
cycle 444, meaning that when the imaging tip of catheter 12 is at point 52, 
the heart 32 of patient 22 is at activity-state TV Point 54 corresponds to 
activity-state T 2 in heart cycle 444, meaning that when the imaging tip of 
catheter 12 is at point 54, the heart 32 of patient 22 is at activity-state T 2 . 
Point 56 corresponds to activity-state T 3 in heart cycle 444, meaning that 
when the imaging tip of catheter 12 is at point 56, the heart 32 of patient 
22 is at activity-state T 3 . Point 58 corresponds to activity-state Ti in heart 
cycle 446. Point 60 corresponds to activity-state T 2 in heart cycle 446. 
Point 62 corresponds to activity-state T 3 in heart cycle 446. Point 64 
corresponds to activity-state Ti in heart cycle 448. Point 66 corresponds to 
activity-state T 2 in heart cycle 448. Point 68 corresponds to activity-state 
T 3 in heart cycle 448. 

According to another aspect of the disclosed technique, location 
and orientation measurements, as well as images acquired, are processed 
with respect to the activity-state of the inspected organ, at the time of 
acquisition or measurement. For example, in a system according to this 
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aspect of the disclosed technique, the imaging system displays the 
trajectory of an imaging catheter superimposed on a three-dimensional 
image of an inspected organ, wherein the three-dimensional image 
corresponds to an activity-state determined by the current location and 
orientation of the imaging catheter inside the inspected organ. The system 
records the path which the imaging catheter follows inside the inspected 
organ, in either a forward or a backward direction. The system, further 
registers this path with monitored activity-states of the inspected organ 
and with the instantaneous location and orientation of the imaging 
catheter. 

Reference is now made to Figures 15A and 15B. Figure 15A is a 
schematic illustration of a system, generally referenced 450, constructed 
and operative in accordance with another embodiment of the disclosed 
technique. Figure 15B is a schematic illustration of trajectories of the tip of 
the imaging catheter of the system of Figure 15A, respective of different 
activity-states of the ECG of Figure 14. 

With reference to Figure 15A, system 450 includes an imaging 
catheter 452, an imaging system 454, an MPS 456, a transmitter 458, a 
body MPS sensor 490, a processor 460, a plurality of ECG electrodes (not 
shown), an ECG monitor 464 and a display 466. Imaging catheter 452 
includes an imaging MPS sensor 468 and an image detector 470, both 
located at a tip 472 of imaging catheter 452. 

In the example set forth in Figure 15A, image detector 470 is an 
optical coherence tomography (OCT) imaging element. It is noted that 
image detector 470 can be replaced with an IVUS transducer as described 
herein above or other types of ultrasound transducers, a magnetic 
resonance imaging (MRI) element, a thermography device, and the like. 

Imaging system 454 produces a signal respective of the images 
which image detector 470 detects. MPS 456, processor 460, ECG monitor 
464 and display 466 are similar to MPS 108 (Figure 1), main computer 
102, ECG monitor 106 and display 130, respectively. Display 466 can be a 
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two-dimensional display, an auto-stereoscopic display to be viewed with a 
suitable pair of spectacles, a pair of goggles, and the like. Location and 
orientation processor of MPS 456 defines the origin of a global coordinate 
system. ECG monitor 464 can be replaced by a dedicated organ monitor 
to monitor the organ timing signals of an organ other than the heart, such 
as intestines, eyelid, eye, brain, liver, lungs, kidneys, and the like. Imaging 
MPS sensor 468 determines the location and orientation of tip 472 of 
imaging catheter 452 and hence, of image detector 470. 

Imaging catheter 452 is located within an inspected organ 474, 
which in the present example is an artery. It is noted that the inspected 
organ can be an organ other than the artery, such as an esophagus, a 
vein, a bronchus, a ureter, and the like. 

The ECG electrodes are attached to the body of a patient 462 
and to ECG monitor 464. Body MPS sensor 490 is attached to the body of 
patient 462 and to MPS 456. Processor 460 is coupled to imaging system 
454, MPS 456, ECG monitor 464 and to display 466. MPS 456 is further 
coupled to imaging MPS sensor 468 and to transmitter 458. Imaging 
system 454 is further coupled to image detector 470. 

For each of the MPS sensors, MPS 456 determines the 
coordinates of the MPS sensor, relative to the origin of the global 
coordinate system. The determined coordinates include three rectilinear 
parameters and three angular parameters. MPS 456 provides MPS 
coordinate data respective of the determined coordinates, to processor 
460. 

Using body MPS sensor 490, MPS 456 determines the location 
and orientation of patient 462, which serves as reference in case the 
patient moves during the operation. The operator (not shown) can 
manually insert or withdraw imaging catheter 452 into or out of inspected 
organ 474, in directions designated by arrows 476 and 478, respectively. 

Following is a description of a scanning process according to 
one embodiment of the disclosed technique. This embodiment overcomes 
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the disadvantages of the prior art by processing imaging data and location 
and orientation data, with respect to organ activity. 

The operator inserts imaging catheter 452 into inspected organ 
474 and moves imaging catheter 452 within inspected organ 474, in 
directions 476 and 478. Image detector 470 detects a plurality of two- 
dimensional images of the region of inspected organ 474, which surrounds 
tip 472 of imaging catheter 452 and provides a respective image signal to 
imaging system 454. Imaging system 454 analyzes the received image 
signal, produces a digital representation of the two-dimensional images 
and provides them as image data to processor 460. 

Using signals received from imaging MPS sensor 468, MPS 456 
determines the location and orientation of tip 472 of imaging catheter 452, 
and hence, the location and orientation of each of the detected two- 
dimensional images, during movement of imaging catheter 452 within 
inspected organ 474. It is noted that the measurements of imaging MPS 
sensor 468 are indifferent to the movement directions 476 and 478 of 
imaging catheter 452. 

The ECG electrodes detect the ECG of patient 462 and provide 
an ECG signal respective of the detected ECG, to ECG monitor 464. ECG 
monitor 464 generates ECG data by analyzing the received ECG signal 
and provides the ECG data to processor 460. 

Processor 460 processes the two-dimensional images, their 
respective location and orientation data and their respective ECG timing, 
and associates each two-dimensional image, with the respective location 
and orientation data and with the respective ECG timing. Processor 460 
sorts the two-dimensional images and their respective location and 
orientation data, according to their respective ECG timing, reconstructs 
three-dimensional images from two-dimensional images respective of 
selected activity states, calculates catheter trajectories from location and 
orientation data respective of selected activity-states, and the like. 
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Processor 460, then stores these two-dimensional images in a database, 
such as adaptive volumetric database 114 (Figure 1). 

For example, with reference to Figure 14, processor 460 
associates between all of the two-dimensional images (i.e., images 
acquired at points 512, 518 and 524) which were detected during activity- 
state T 1 at any cycle of ECG signal 442. Similarly, processor 460 
associates between all of the two-dimensional images (i.e., images 
acquired at points 514, 520 and 526) which were detected during activity- 
state T 2 at any cycle of ECG 442 and further associates between all of the 
two-dimensional images (i.e., images acquired at points 516, 522 and 528) 
which were detected during activity-state T 3 at any cycle of ECG 442. 

Processor 460 reconstructs a three-dimensional image from all 
of the two-dimensional images, which were associated with respect to a 
given activity-state Tj. With reference to Figure 15B, processor 460 
reconstructs a three-dimensional image 500, which is the image of 
inspected organ 474 at activity-state T A (Figure 14), and a three- 
dimensional image 502, which is the image of inspected organ 474 at 
activity-state T 2 . Likewise, processor 460 reconstructs a three-dimensional 
image 504, which is the image of inspected organ 474 at activity-state T 3 . 

Processor 460 calculates a trajectory 506 from points 512, 518 
and 524, associated with activity state TV Similarly, processor 460 
calculates a trajectory 508 from points 514, 520 and 526 associated with 
activity state T 2 and further calculates a trajectory 510 from points 516, 
522 and 528 associated with activity state T 3 . 

Processor 460 associates between each of the calculated 
trajectories and one of the reconstructed three-dimensional images, 
respective of a given organ activity-state. With reference to Figure 15B, 
processor 460 associates between trajectory 512 and reconstructed three- 
dimensional image 500, respective of activity state TV Similarly, processor 
460 associates between trajectory 514 and reconstructed three- 
dimensional image 502, respective of activity state T 2 and further between 
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trajectory 514 and reconstructed three-dimensional image 504, respective 
of activity state T 3 . 

Since points 512, 514, 516, 518, 520, 522, 524, 526 and 528, 
used for calculating the trajectories are also the points at which their 
respective two-dimensional images were acquired, processor 460 can 
superimpose each of the calculated trajectories on its respective 
reconstructed three-dimensional image. For example, processor 460 
superimposes trajectory 506 on three-dimensional image 500, trajectory 
508 on three-dimensional image 502 and trajectory 510 on three- 
dimensional image 504. 

It is noted that points 512, 514, 516, 518, 520, 522, 524, 526 
and 528 represent a situation similar to that presented by points 52, 54, 
56, 58, 60, 62 64, 66 and 68 (Figure 13B). However, according to the 
disclosed technique, processor 460 reconstructs each three-dimensional 
image, and calculates each of the trajectories, with respect to those 
coordinates of the tip of the imaging catheter, which belong to the same 
activity-state as that of the reconstructed three-dimensional image. 

It is noted that processor 460 monitors the travel speed of 
imaging catheter 452 during the scanning process, according to data 
received from MPS 456. It is noted that a predetermined number of two- 
dimensional images, per travel of the imaging detector 470, is required, so 
as to fill the three-dimensional volume with enough image data. Some 
image detectors can only detect so many images in a given time period. 
Hence, processor 460 detects that the travel speed of imaging detector 
470 catheter 452 is equal to or below a predetermined threshold, which 
determines that the image detector 470 detected enough two-dimensional 
images, for any given portion of the inspected volume. If processor 460 
detects that the travel speed of imaging detector 470 is above a 
predetermined threshold, then processor 460 produces an alarm signal to 
notify the operator that the scan is unacceptable or should be repeated, 
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partially or completely. The operator then repeats the scanning process. 
The type of the alarm signal is audio, visual, tactile, and the like. 

The term "surgical procedure" herein below, refers to an in vivo 
operation on an organ of the patient, such as performing an incision, 
collecting a sample of a tissue, collecting a sample of bodily fluids, 
introducing a chemical substance into the organ, introducing a surgical 
tool or device, and the like. 

Reference is now made to Figures 16A, 16B, 16C and 16D. 
Figure 16A is a schematic illustration of the system of Figure 15A, further 
adapted for surgical procedure. Figure 16B is a schematic illustration of a 
graphical user interface (GUI), generally referenced 730, constructed and 
operative in accordance with a further embodiment of the disclosed 
technique. Figure 16C is a schematic illustration of a GUI, generally 
referenced 760, constructed and operative in accordance with another 
embodiment of the disclosed technique. Figure 16D is a schematic 
illustration of a process of reconstructing a three-dimensional organ 
motion dependent image sequence, and superimposing additional visual 
data thereon, by processing the signals received from the imaging system, 
the MPS and the ECG monitor. The additional visual data can include the 
location of surgical equipment within the inspected organ, the trajectory of 
a catheter within the inspected organ, and the like. 

With reference to Figure 16A, system 450 further includes a 
surgical catheter 480, a guidance unit 482 and a real-time imaging system 
484. Surgical catheter 480 further includes a surgical tool 486 and a 
catheter MPS sensor 488 at the tip thereof. Surgical tool 486 is one of a 
variety of interchangeable surgical devices, which can be mounted onto 
surgical catheter 480. It is noted that surgical tool 486 is a conventional 
tool, such as clamp, laser cutter, brush, catheter, stent, balloon, pace 
maker electrode, ablation catheter, electrophysiological mapping device, 
solution dispensing unit, neuron electrode, substance collection unit, 
surgical delivery tool (e.g., for delivering genes, drugs, devices and the 
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like), endoscope, imaging device, and the like, or a combination thereof. 
For example, a device delivery tool can be a medical tool for delivery of a 
medical device, such as a permanent stent, a removable stent, and the 
like, to the body of patient 462. Catheter MPS sensor 488 is coupled to 
MPS 456. 

Guidance unit 482 is coupled to surgical catheter 480. Guidance 
unit 482 is a device for navigating surgical catheter 480 within inspected 
organ 474 in space. Real-time imaging system 484 is an imaging system 
which constantly provides a real time image of that portion of the body of 
patient 462, which includes inspected organ 474. Real-time imaging 
system 484 is an X-ray table, a fluoroscopic unit, an ultrasound system, an 
MRI system and the like. In the present example, real-time imaging system 
484 is located either under or above the body of patient 462 and is 
coupled to processor 460. 

When the operator completes scanning inspected organ 474 
(Figure 15A) and processor 460 produces three-dimensional images of 
inspected organ 474, imaging catheter 452 can be removed from 
inspected organ 474. Surgical catheter 480 is then inserted in inspected 
organ 474, in order to perform a surgical procedure on inspected organ 
474. 

System 450 can play back the stored three-dimensional images 
in synchrony with the stored organ timing signal of the patient or 
sequentially, at any speed. System 450 can also be used during surgical 
procedures wherein system 450 plays back the stored three-dimensional 
images in synchrony with the real-time organ timing signal of the patient. 
System 450 can introduce additional information to the played back 
sequence of three-dimensional images. This additional information can 
include a representation of a surgical tool, a trajectory of the surgical tool, 
which was calculated during the scanning process, real time imaging data, 
and the like. 
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During the surgical procedure, MPS 456 determines the real- 
time location and orientation of surgical tool 486, according to signals 
received from catheter MPS sensor 488, and MPS 456 provides MPS 
coordinate data respective of this location and orientation, to processor 
460. Real-time imaging system 484 acquires a real-time image of the body 
of patient 462 and provides real-time image data to processor 460. ECG 
monitor 464 detects the activity of the heart of patient 462 and provides 
real-time ECG data to processor 460. Processor 460 selects a three- 
dimensional image of the inspected organ 474, from a database, such as 
adaptive volumetric database 114 (Figure 1), according to the real-time 
detected activity-state of the heart of patient 462 during the surgical 
procedure. 

Processor 460 selects a trajectory from the trajectories, which 
were calculated during the scanning process, according to the real-time 
detected activity-state of the heart of patient 462. Processor 460 
superimposes this selected trajectory on the selected three-dimensional 
image. Once the coordinate system of the surgical tool MPS sensor and 
the coordinate system of the pre-stored three-dimensional image 
sequence, are aligned, processor 460 can add a representation of the 
surgical tool on the three-dimensional image sequence. 

It is noted that processor 460 can further alter the visual 
representation of the trajectory according to the location of the surgical 
tool. For example, processor 460 can set a selected color to a portion of 
the trajectory from the location of the surgical tool tip backward, in one 
color, thereby indicating the previous path of the surgical catheter. 
Similarly, processor 460 can set a different color to the portion of the 
trajectory from the location of the surgical tool tip forward, thereby 
indicating a theoretical path of the surgical catheter, should the physician 
move it forward. 

Display 466 displays a graphical user interface (GUI) according 

to the video signals received from processor 460. This GUI can include a 
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variety of medical information respective of an inspected organ of a 
patient, thereby facilitating the interaction of the user with the inspected 
organ. The GUI can include different windows which display images of the 
inspected organ from different views, or as detected by different types of 
image detectors. In addition, the GUI can include information respective of 
the organ timing signal and provisions to view different views of the 
inspected organ corresponding to different activity-states of the organ. The 
GUI can include auxiliary information, such as the location and orientation 
of a surgical tool in real-time, the trajectory of the surgical tool in the past 
and in the future, and the like. 

In the example set forth in Figure 16B, GUI 730 includes 
windows 732 and 734. Window 732 includes a reconstructed external 
three-dimensional navigation image 736 of an inspected organ. It is noted 
that this external three-dimensional image can be reconstructed in a semi- 
transparent manner, such that the near wall is colored in a transparent 
fashion and hence, the far wall can be seen through the near wall. 

The inspected organ in this example is the descending aorta 744 
of patient 462. Window 732 further includes a representation 738 of a 
surgical tool, similar to surgical tool 486, superimposed on external three- 
dimensional navigation image 736. 

External three-dimensional navigation image 736 is the real-time 
three-dimensional sequence of images of descending aorta 744, 
corresponding to the real-time detected activity-state of the heart of patient 
462. Processor 460 superimposes representation 738 of surgical tool 486 
in real-time, on external three-dimensional navigation image 736, 
according to real-time coordinate data which processor 460 receives from 
MPS 456. Thus, representation 738 indicates the current location and 
orientation of surgical tool 486 within descending aorta 744. 

According to another aspect of the disclosed technique, 
processor 460 selects a three-dimensional image of the inspected organ, 

according to the organ real-time detected activity-state and superimposes 
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a projection of the selected three-dimensional image on the real-time two- 
dimensional navigation image. In the example set forth in Figure 16B, GUI 
734 includes a real-time two-dimensional navigation image 758 of the 
region of the body of the patient, which is under operation. In this example, 
this region includes the heart 740 of patient 462 and the veins and arteries 
which are coupled to heart 740, such as the ascending artery 742, 
descending aorta 744, superior vena cava 746, pulmonary trunk 748, 
abdominal aorta 750 and inferior vena cava 752. 

Processor 460 superimposes a projection 754 of reconstructed 
three-dimensional image 736 on real-time two-dimensional navigation 
image 758, which is acquired by real-time imaging system 484, thereby 
producing the combined two-dimensional image presented in window 734. 
Processor 460 further superimposes representation 756 of surgical tool 
486 on real-time two-dimensional navigation image 758. Representation 
756 indicates the current location and orientation of surgical tool 486 
within descending aorta 744. Processor 460 selects projection 754, in real- 
time according to a real-time detected activity-state of the heart of patient 
462 and hence follows the visual activity of real-time two-dimensional 
navigation image 758. 

It is noted that the location of real-time imaging system 484 
relative to the origin of the global coordinate system is determined either 
according to a fixed predetermined location relative to transmitter 458, or 
according to an MPS sensor coupled to real-time imaging system 484. 

Processor 460 superimposes two-dimensional image 754 on the 
actual location of descending aorta 744, in real-time two-dimensional 
navigation image 758, according to the MPS coordinate data acquired 
during the scanning process (Figure 15A). In this manner, the operator 
can navigate surgical catheter 480 within descending aorta 744, with the 
aid of guidance unit 482, by observing the instantaneous location and 
orientation of surgical catheter 480, on a highlighted portion of the body of 
patient 462 (i.e., on projection 754 in window 734). 
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With reference to Figure 16C, GUI 760 includes windows 762 
and 764. Window 762 includes a reconstructed external three-dimensional 
navigation image 766 of another inspected organ of patient 462. In this 
case, the inspected organ is the left main and left anterior descending (LM 
& LAD) coronary artery 776 of the heart 770 of patient 462. Window 762 
further includes a representation 768 of a surgical tool, similar to surgical 
tool 486, superimposed on external three-dimensional navigation image 
766. 

Window 764 includes a real-time two-dimensional navigation 
image 772 of the heart 770. Heart 770 includes LM & LAD coronary artery 
776. Processor 460 superimposes a projection 774 of reconstructed three- 
dimensional image 766 on real-time two-dimensional navigation image 
772, which is acquired by real-time imaging system 484, thereby 
producing the combined two-dimensional image presented in window 764. 
Processor 460 further superimposes a representation 778 of surgical tool 
486 on real-time two-dimensional navigation image 772. Representation 
778 indicates the current location and orientation of surgical tool 486 
within LM & LAD coronary artery 776. 

Following is a graphical representation of the process by which 
processor 460 generates a three-dimensional image, including auxiliary 
information, such as the trajectory of a surgical tool, a representation of 
the surgical tool, and the like. Processor 460 generates the three- 
dimensional image by processing different data, such as the detected 
image data, the MPS coordinate data, the organ timing data, and the like. 

With reference to Figure 16D, processor 460 reconstructs three- 
dimensional image 502 of inspected organ 474, from a plurality of two- 
dimensional images 554, according to MPS coordinate data 552, all of 
which respective of a selected activity state within the cycles of ECG data 
556. Processor 460 reconstructs three-dimensional image 502 from all the 
two-dimensional images which belong to of activity-state T 2 . In addition, 
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processor 460 generates a trajectory 558 of imaging catheter tip, which 
corresponds to activity-state T 2 , from points 514, 520 and 526. 

System 450 can playback the sequence of reconstructed images 
or a selected cycle of the originally acquired two-dimensional images, 
according to the stored ECG data or at predetermined time intervals. 
System 450 can also playback the sequence of reconstructed images or a 
selected cycle of the originally acquired two-dimensional images, in 
synchrony with real-time detected ECG data. 

It is noted that since the surgical tool moves within the inspected 
organ in real-time, no synchronization is required with respect to the organ 
timing signal in that aspect. However, it is noted that processor 460 has to 
register the coordinate system in which the images were acquired, with the 
coordinate system of the MPS sensor of the surgical tool, or to use the 
same MPS system for the image acquisition process and the playback 
surgical procedure. 

Reference is now made to Figure 17, which is a schematic 
illustration of an internal three-dimensional navigation image of an 
inspected organ, generally referenced 600, constructed and operative in 
accordance with a further embodiment of the disclosed technique. Internal 
three-dimensional navigation image 600 includes an inner wall image 602 
of an inspected organ, such as inspected organ 474 (Figure 15A), as if the 
operator was located inside the inspected organ. Internal three- 
dimensional navigation image 600 further includes a surgical tool 
representation 604 of the current location of a surgical tool, such as 
surgical tool 486 (Figure 16A), during the surgical operation. Internal 
three-dimensional navigation image 600 further includes surgical catheter 
representation 606 of the surgical catheter viewed from behind the current 
location of the surgical tool. Internal three-dimensional navigation image 
600 further includes a trajectory representation 608 of the future trajectory 
of an imaging catheter, such as imaging catheter 452 (Figure 15A), 
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following the current location of the surgical tool, as viewed from the 
current location of the surgical tool. 

Inner wall image 602 is the image of the inspected organ, 
surrounding image detector 470. Trajectory representation 608 represents 
the trajectory which the tip of the imaging catheter had traveled within the 
inspected organ, during the scanning process (Figure 15A). Trajectory 
representation 608 displays the theoretical forward path, which the 
surgical catheter will follow within the inspected organ, should the operator 
advance the surgical catheter forward within the inspected organ. 

Reference is now made to Figure 18, which is a schematic 
illustration of an ECG coordinated display of an inspected organ, generally 
referenced 630, constructed and operative in accordance with another 
embodiment of the disclosed technique. ECG coordinated display 630 
includes an ECG timing signal 632, a forward button 634, a backward 
button 636, a freeze button 638 and an external three-dimensional image 
640 of an inspected organ, such as inspected organ 474 (Figure 15A). 

External three-dimensional image 640 is displayed in a window 
642 and corresponds with an activity-state 644 in ECG timing signal 632. 
When the operator presses forward button 634, a sequence of external 
three-dimensional images of the inspected organ is displayed in window 
642. Each of the external three-dimensional images displayed in window 
642, corresponds with the respective activity-state in ECG timing signal 
632, as if ECG timing signal 632 would advance in a direction designated 
by an arrow 646. 

When the operator presses backward button 636, a sequence of 
external three-dimensional images of the inspected organ is successively 
displayed in window 642. Each of the external three-dimensional images 
displayed in window 642 corresponds with the respective activity-state in 
ECG timing signal 632, as if ECG timing signal 632 would retard in a 
direction designated by an arrow 648. 
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When the operator presses freeze button 638, an external three- 
dimensional image of the inspected organ is displayed in window 642, 
wherein the external three-dimensional image corresponds with a selected 
activity-state 650. In this manner the external three-dimensional image of 
the inspected organ in window 642 remains stationary at activity-state 650, 
during which the physician can inspect the three-dimensional image of the 
inspected organ. 

Each of the external three-dimensional images, which are 
displayed in window 642, is acquired by system 450 (Figure 15A), during 
the scanning process. Thus, the operator can view animated external 
three-dimensional images of the inspected organ as the heart of the 
patient would beat either forward or backward in time. The operator can 
alternatively view an external three-dimensional image of the inspected 
organ, which corresponds with a selected activity-state during a selected 
heart cycle of the patient, by pressing freeze button 638 at a selected point 
in time. It is noted that other sequenced images, such as a reference real- 
time image (i.e., served as road map during navigation, such as a 
fluoroscopic image, and the like) can also be made to freeze-up. 

Reference is now made to Figures 19A and 19B. Figure 19A is a 
schematic illustration of a GUI, generally referenced 670, constructed and 
operative in accordance with a further embodiment of the disclosed 
technique. Figure 19B is a schematic illustration of a GUI, generally 
referenced 700, constructed and operative in accordance with another 
embodiment of the disclosed technique. 

With reference to Figure 19A, GUI 670 includes a transverse 
cross sectional image 672 of an inspected organ, a horizontal ruler 674, a 
vertical ruler 676, a plurality of vertical guides 678i, 678 2 , 678 3 , 678 4 , 678 5 
and 678 6 , and a plurality of horizontal guides 680! , 680 2 , 680 3 , 680 4 and 
680 5 . Transverse cross sectional image 672 includes an image of a plaque 
682. The operator measures the geometrical parameters of the inspected 
organ, such as diameter, area, percent occlusion, and the like, by reading 
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the location of vertical guides 678i, 678 2) 678 3 , 678 4 , 678 5 and 678 6) and 
horizontal guides 68O1, 680 2 , 680 3 , 680 4 and 680 5 on horizontal ruler 674, 
and vertical ruler 676, respectively. The operator also measures the size of 
plaque 682. Alternatively, the geometrical parameters are written on GUI 
670. Further alternatively, the geometrical parameters are announced via 
a speaker. 

With reference to Figure 19B, GUI 700 includes a longitudinal 
cross sectional image 702 of an inspected organ, a horizontal ruler 704, a 
vertical ruler 706, a plurality of vertical guides 708! and 708 2 , and a 
plurality of horizontal guides 710!, 710 2 , 710 3 and 71 0 4 . Longitudinal cross 
sectional image 702 includes a plaque 712. The operator measures the 
geometrical parameters of the inspected organ, such as diameter, area, 
percent occlusion, and the like, by reading the location of vertical guides 
708! and 708 2 , and horizontal guides 710!, 71 0 2 , 71 0 3 and 71 0 4 on 
horizontal ruler 704 and vertical ruler 706, respectively. The operator also 
measures the size of plaque 712. Alternatively, the geometrical 
parameters are written on GUI 700. Further alternatively, the geometrical 
parameters are announced via a speaker. 

Reference is now made to Figure 20, which is a schematic 
illustration of a GUI, generally referenced 780, constructed and operative 
in accordance with a further embodiment of the disclosed technique. GUI 
780 includes windows 782, 784, 786 and 788, an ECG timing signal 790, a 
forward button 792, a backward button 794 and a freeze button 796. GUI 
780 provides a quantitative model, by which the user acquires a realistic 
notion of the navigation process within the body of the patient. 

Window 782 is similar to window 732 of Figure 16B. Window 
784 includes an image similar to the internal image of an inspected organ 
600 of Figure 17. 

Window 786 includes historical two-dimensional information of 
the inspected organ, while the image detector is located inside the 

inspected organ. Window 788 is similar to window 734 of Figure 16B. ECG 
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timing signal 790 is similar to ECG timing signal 632 of Figure 18. Forward 
button 792, backward button 794 and freeze button 796, are similar to 
forward button 634, backward button 636 and freeze button 638, 
respectively, of Figure 1 8. 

Reference is now made to Figure 21, which is a schematic 
illustration of a trajectory, corrected according to the location and 
orientation of the tip of the surgical tool of the system of Figure 16A, in 
accordance with another embodiment of the disclosed technique. During 
the surgical operation, the operator successively locates surgical tool 486 
(Figure 16A), at points 512, 580 and 524. Points 512 and 524 are located 
on trajectory 506, which processor 460 generated according to the 
trajectory of tip 472 of imaging catheter 452 (Figure 15A), during the 
scanning process. Trajectory 506 is defined by points 512, 518 and 524 
and point 580 is not located on trajectory 506. Processor 460 makes 
corrections to trajectory 506 and generates a corrected trajectory 582, 
defined by points 512, 580 and 524 and display 466 displays corrected 
trajectory 582, accordingly, superimposed on external three-dimensional 
navigation image 500. 

Reference is now made to Figure 22, which is a schematic 
illustration of a method for operating system 450 of Figure 15A, operative 
in accordance with a further embodiment of the disclosed technique. In 
procedure 820, the organ timing signal of the inspected organ is detected. 
With reference to Figure 15A, ECG monitor 464 detects the activity-state 
of the heart of patient 462, such as ECG timing signal 442 (Figure 14). 

In procedure 822, a plurality of two-dimensional images of the 
inspected organ are detected by an image detector. With reference to 
Figure 15A, image detector 470 detects two-dimensional images 554 
(Figure 16D) of inspected organ 474. The image detector can be an 
ultrasound detector, and OCT detector, MRI device, thermography device, 
and the like. 
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In procedure 824, the location and orientation of the image 
detector is detected. With reference to Figure 15A, imaging MPS sensor 
468 detects the location and orientation of image detector 470. 

In procedure 826, each two-dimensional image is associated 
with the detected location and orientation of the image detector and a 
respective organ timing signal reading. With reference to Figures 15A and 
16D, processor 460 associates each of the two-dimensional images 554 
with the respective MPS coordinate data 552 of image detector 470 and 
the respective activity state of the ECG timing signal 556. 

In procedure 828, a plurality of three-dimensional images are 
reconstructed from the two-dimensional images. Each reconstructed 
three-dimensional image corresponds to a selected position within the 
organ timing signal cycle. With reference to Figures 14, 15A and 15B, 
processor 460 reconstructs external three-dimensional navigation images 
500, 502 and 504, corresponding to activity-states T 1f T 2 and T 3 , 
respectively. When the heart of patient 462 is for example, at activity-state 
T 2 , processor 460 selects external three-dimensional navigation image 
502 (procedure 830). 

In procedure 832, the location and orientation of a surgical tool 
is detected. With reference to Figure 16A, catheter MPS sensor 488 
detects the location and orientation of surgical tool 486 of surgical catheter 
480 and processor 460 superimposes a representation of surgical tool 
486, according to the detected location and orientation, onto the selected 
three-dimensional image (procedure 834). 

In procedure 836, a real time image is detected. With reference 
to Figure 16A, real-time imaging system 484 detects a real time image of 
that portion of the body of patient 462, which includes inspected organ 
474. 

In procedure 838, a projection of the selected three-dimensional 
image is superimposed on the detected real time image. With reference to 
Figure 16B, processor 460 superimposes projection 754 of reconstructed 
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three-dimensional image 736 on real-time two-dimensional navigation 
image 758. It is noted that the outcome of this procedure yields a 
quantitative model, which provides the user a very realistic notion of the 
actual navigation within the body of the patient. 

In procedure 840, the result of the superpositions is displayed. 
With reference to Figures 16A and 16B, a superposition of representation 
756 of surgical tool 486 on real-time two-dimensional navigation image 
758 and a projection 754 of reconstructed three-dimensional image 736 on 
real-time two-dimensional navigation image 758, are displayed on display 
466. 

According to another aspect of the disclosed technique, system 
450 displays a reconstructed three-dimensional image of the inspected 
organ, on which the occluded regions are marked. Furthermore, the 
operator can direct system 450 to mark only those regions of the inspected 
organ, whose occlusions are equal to or more than a selected limit. 

Reference is now made to Figures 23A, 23B and 23C. Figure 
23A is an illustration of an artery, generally referenced 850, having a 
plurality of occluded regions. Figure 23B is a cross-sectional view of a 
selected region of artery 850 of Figure 23A. Figure 23C is a schematic 
illustration of a representation of the artery of Figure 23B in a graphical 
user interface (GUI), generally referenced 860, operative in accordance 
with another embodiment of the disclosed technique. 

Artery 850 includes plaques 852, 854 and 856. It is noted that 
plaques 852, 854 and 856 can be fixed in their places or be dynamic. 
Plaques 852, 854 and 856 block artery 850 by 75%, 60% and 80%, 
respectively. With reference to Figure 23B, the hatched area denotes the 
blockage due to plaque 852 within artery 850, leaving lumen 858 open for 
blood flow. 

Processor 460 can determine the percentage of occlusion, 
according to a plurality of methods, taking into account parameters such 
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as plaque type, plaque density, and the like. The following is a simple 
example for such a method: 



/o BLOCKED ~ 



j °VUMEN 
$ ARTERY J 



100 



where, S LUM en denotes the area of lumen 858 and S ART ery denotes the 
total internal area of artery 850. 

GUI 860 includes a graphical window 862. Graphical window 
862 includes a reconstructed three-dimensional image 864 of artery 850 
and a ratio selection window 866. Ratio selection window 866 includes a 
graduation bar 874, a pointer 876 and a numerical box 878. The operator 
can dynamically set the occlusion percentage threshold, by dragging 
pointer 876 along graduation bar 874, using a pointing device, such as a 
mouse, a stylus and a digital tablet, and the like. Alternatively, the operator 
can enter a selected occlusion percentage threshold in numerical box 878, 
through a user interface, such as keyboard, microphone, and the like. In 
the example set forth in Figure 23B, the numerical value 70%, of the 
selected percentage is shown in numerical box 878. 

System 450 then marks only those regions on reconstructed 
three-dimensional image 864, which are occluded more than the selected 
occlusion percentage. In the example set forth in Figure 23B, only those 
regions of artery 850 which are occluded 70% or more, are marked in 
reconstructed three-dimensional image 864. Plaques 852 and 856, which 
exceed 70%, are represented by marked regions 868 and 870, 
respectively, on reconstructed three-dimensional image 864. Marked 
regions 868 and 870 are differentiated from the rest of the portions of 
reconstructed three-dimensional image 864, by being colored in a different 
hue, marked by hatches, animated, and the like. 

It is noted the system enables the user to manually correct the 

marking on screen, in case that the user, according to her medical 

knowledge and experience detects for example, that the plaque portion 

should be different than what the system indicated. For example, if the 

-69- 



WO 02/064011 



PCT/1L02/00108 



user detects that the image presented in window 786 (Figure 20) provides 
additional information regarding plaque 852, by which plaque 852 blocks 
less than what is shown on screen, then the user can mark plaque 852 on 
screen, accordingly. It is further noted that the system can present the 
various layers of the lumen (i.e., media, adventitia and intima), in GUI 860, 
in different colors. 

Reference is now made to Figure 24, which is a schematic 
illustration of a method for operating the graphical user interface of Figure 
23C, operative in accordance with a further embodiment of the disclosed 
technique. In procedure 900, an occlusion value is received. With 
reference to Figure 23C, the operator sets an occlusion threshold of 70%, 
via ratio selection window 866 and processor 460 receives this selected 
occlusion threshold. 

In procedure 902, a plurality of occlusion values are determined 
for an inspected organ. With reference to Figure 23A, processor 460 
determines that plaques 852, 854 and 856 block artery 850 by 75%, 60% 
and 80%, respectively. 

In procedure 904, the determined occlusion values are 
compared with the selected occlusion value. With reference to Figures 
23A and 23C, processor 460 compares the percentage occlusions 75%, 
60% and 80% of plaques 852, 854 and 856, respectively, with the selected 
occlusion threshold of 70%. 

In procedure 906, at least one occluded region is determined, 
according to the outcome of the comparison. With reference to Figures 
23 A and 23C, processor 460 determines that plaques 868 and 870 are the 
occluded regions, which are to be displayed. This is so, because the 
percentage occlusions of plaques 868 and 870 (75% and 80%, 
respectively) are greater than the selected occlusion threshold of 70%, 
while the percentage occlusion of plaque 854 (i.e., 60%) is less than 70%. 
With reference to Figure 23C, plaques 852 and 856 are represented as 
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marked regions 868 and 870, respectively, in reconstructed three- 
dimensional image 864 (procedure 908). 

According to another aspect of the disclosed technique, the 
three-dimensional image of an inspected organ at a selected activity-state, 
is reconstructed from two-dimensional images of the inspected organ, 
which are detected during other activity-states of the inspected organ. 
Since more two-dimensional images are available for reconstruction of the 
three-dimensional image, the processor can reconstruct a more detailed 
image of the inspected organ at this selected activity-state. It is noted that 
this aspect of the disclosed technique can be applied for organs, which 
exhibit negligible deformation, or organs with known deformation. 

In this case, the inspected organ is a vessel, such as an artery, 
bronchus, esophagus, and the like, whose geometry remains substantially 
constant at all activity-states of the organ timing signal, and that only the 
location and orientation of the vessel changes. The processor incorporates 
the two-dimensional images of the vessel detected at different activity- 
states, with the two-dimensional images detected at the selected activity- 
state, while changing the coordinates (i.e., the locations and orientations) 
of the incorporated two-dimensional images to those coordinates which 
were detected during the selected activity-state. 

Reference is now made to Figures 25A, 25B and 25C. Figure 
25A is a schematic illustration of the images of a vessel at three different 
activity-states, generally referenced 950, 952 and 954. Figure 25B is a 
schematic illustration of one of the two-dimensional images acquired at 
one activity-state, translated to another activity-state, in accordance with 
another embodiment of the disclosed technique. Figure 25C is a 
schematic illustration of the image of the vessel of Figure 25A at one of 
the activity-states, reconstructed in accordance with the embodiment of 
Figure 25B, from the two-dimensional images of the vessel, which are 
detected at the other two activity-states. Figure 25D is a schematic 
illustration of the image of the vessel of Figure 25A at another activity- 
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state, reconstructed in accordance with the embodiment of Figure 25B, 
from the two-dimensional images of the vessel, which are detected at the 
other two activity-states. 

With reference to Figure 25A, three-dimensional image 950 of 
inspected organ 474 (Figure 15A), is reconstructed from two-dimensional 
images 956^ 956 2 , 956 3 , and 956 4 detected during activity-state TV The 
path of imaging catheter 452 during activity-state T 1 is represented by a 
trajectory 958. Three-dimensional image 952 of inspected organ 474 is 
reconstructed from two-dimensional images 960^ 960 2 , 960 3 , and 960 4 
detected during activity-state T 2 . The path of imaging catheter 452 during 
activity-state T 2 is represented by a trajectory 962. Three-dimensional 
image 954 of inspected organ 474 is reconstructed from two-dimensional 
images 964^ 964 2 , 964 3 , 964 4 and 964 5 detected during activity-state T 3 . 
The path of imaging catheter 452 during activity-state T 3 is represented by 
a trajectory 966. 

The coordinates of two-dimensional images 956^ 956 2 , 956 3 , 
and 956 4 are represented by points 968^ 968 2 , 968 3l and 968 4 , 
respectively. The coordinates of two-dimensional images 960 1 , 960 2 , 960 3 , 
and 960 4 are represented by points 970^ 970 2 , 970 3 , and 970 4 , 
respectively. The coordinates of two-dimensional images 964^ 964 2 , 964 3 , 
964 4 and 964 5 are represented by points 972 1? 972 2 , 972 3 , 972 4 and 972 5 , 
respectively. 

It is noted that processor 460 computes each of the different 
trajectories 958, 962 and 966 for the path which imaging catheter 
supposedly follows inside inspected organ 474, during different activity- 
states of inspected organ 474. Otherwise, trajectories 958, 962 and 966 
belong to the same scanning process, and are traversed during the same 
time period. Hence, points 968! , 97d and 972) which designate the start 
of trajectories 958, 962 and 966, respectively, belong to the same point in 
time. Likewise, points 956 4 , 970 4 and 972 5 which designate the end of 
trajectories 958, 962 and 966, respectively, belong to another point in time. 
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Thus, a two-dimensional image which belongs to one activity-state and is 
located at a certain fraction of the length of one trajectory, can be 
translated to a respective location on another trajectory and to another 
activity-state, according to the same fraction of the length of this other 
trajectory. 

With reference to Figure 25B, two-dimensional image 960 2 is 
acquired at activity-state T 2 and the coordinates associated therewith, are 
represented by point 970 2 . Processor 460 determines shifted coordinates 
for the image 960 2 on trajectory 958, operating under the assumption that 
these coordinates would have been detected by the imaging MPS sensor 
468, had this image been acquired during activity state T v 

In the present example, processor 460 determines these new 
coordinates using the fact that the changes in the length of the artery are 
minor through all of the activity states. Accordingly, the distance of point 
970 2 from point 970i (i.e., from the beginning of trajectory 962), is equal to 
a fraction b of the entire length of trajectory 962 (i.e., from point 970) to 
point 970 4 ). Processor 460 determines the translated coordinates 
represented by point 970 2T on trajectory 958, according to the fraction b of 
the length of trajectory 958 from point 968!. Processor 460, then can use 
two-dimensional image 960 2 from activity-state T 2 for reconstructing the 
three-dimensional image associated with activity-state T 1f using translated 
coordinates represented by point 970 2T . 

With reference to Figure 25C, processor 460 reconstructs a 
three-dimensional image 974 of inspected organ 474 at activity-state in 
the following manner. Processor 460 translates two-dimensional image 
960 2 from activity-state T 2 to activity-state Ti, as translated two- 
dimensional image 960 2T as described herein above. 

Processor 460 determines that point 972 2 is located at a fraction 
c of the length of trajectory 966. Processor 460 determines the translated 
coordinates represented by a point 972 2T on trajectory 958, according to 
the same fraction c of the length of trajectory 958. Processor 460, then 
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translates two-dimensional image 964 2 form activity-state T 3 to activity- 
state T lf as a translated two-dimensional image 964 2T . 

Processor 460 determines that point 972 3 is located at a fraction 
of of the length of trajectory 966. Processor 460 determines the translated 
coordinates represented by a point 972 3T on trajectory 958, according to 
the same fraction d of the length of trajectory 958, Processor 460, then 
translates two-dimensional image 964 3 from activity-state T 3 to activity- 
state T 1f as a translated two-dimensional image 964 3T . Likewise, 
processor 460 determines the translated coordinates represented by 
points 972 1T , 970 1T , 970 3T , 972 4Tf 972 5T and 970 4T for translated two- 
dimensional images 964 1Tj 960 1T , 960 3T , 964 4T , 964 5T and 960 4T , 
respectively. 

In this manner, processor 460 reconstructs three-dimensional 
image 950 from two-dimensional images 964 1T , 960 1T , 956i, 960 2T , 964 2T , 
956 2 , 964 3T , 960 3T , 956 3 , 964 4T , 956 4 , 964 5T and 960 4T which are 
substantially greater in number than the original two-dimensional images 
956 1f 956 2 , 956 3 and 956 4 (Figure 25A). Accordingly, processor 460 can 
reconstruct three-dimensional image 974, which is substantially more 
detailed than three-dimensional image 950. 

With reference to Figure 25D, processor 460 reconstructs a 
three-dimensional image 976 for activity-state T 2 , from the original two- 
dimensional images 960i, 960 2 , 960 3 and 960 4 and from additional two- 
dimensional images which belong to activity-states T t and T 3 . Part of 
these additional two-dimensional images are references 956 1? 956 2 , 956 3 
and 956 4 which are translated from activity-state to activity-state T 2 , as 
translated two-dimensional images 956 1T , 956 2T , 956 3T and 956 4T , 
respectively. Translated two-dimensional images 956 1T , 956 2T , 956 3T and 
956 4T possess the translated coordinates represented by points 968 1T , 
968 2T , 968 3T and 968 4T , respectively. The other additional two-dimensional 
images are references 964 ni 964 2 , 964 3t 964 4 and 964 5 which are 
translated from activity-state T 3 to activity-state T 2 , as translated two- 

-74- 



WO 02/064011 



PCT/IL02/00108 



dimensional images 964 1T , 964 2T , 964 3T , 964 4T and 964 5T , respectively. 
Translated two-dimensional images 964 1T , 964 2T , 964 3T , 964 4T and 964 5T 
possess translated coordinates represented by points 972 u 972 2 , 972 3 , 
972 4 and 972 5 , respectively. 

It is noted that since three-dimensional image 976 is 
reconstructed from a substantially large number of two-dimensional 
images, three-dimensional image 976 is substantially more detailed than 
three-dimensional image 952, which is reconstructed from two- 
dimensional images which belong only to one activity-state. It is further 
noted that processor 460 can reconstruct a detailed three-dimensional 
image for each activity-state, from all the two-dimensional images of all 
other activity-states, in addition to two-dimensional images which belong to 
the activity-state under reconstruction. 

Reference is now made to Figure 26, which is a schematic 
illustration of a method for reconstructing a three-dimensional image, 
operative according to a further embodiment of the disclosed technique. In 
procedure 1000, an activity-state is selected. With reference to Figures 14, 
15A, 25 A and 25C, processor 460 selects activity-state T 1f for which three- 
dimensional image 974 is to be reconstructed. 

In procedure 1002, translated coordinates for an auxiliary two- 
dimensional image, which belongs to an activity-state other than the 
selected activity-state, are determined according to the original 
coordinates of the auxiliary two-dimensional image, and according to 
coordinates of the trajectory associated with the selected activity-state. 
With reference to Figure 25B, processor 460 determines the translated 
coordinates for two-dimensional image 960 2 represented by point 970 2T> 
which belongs to activity-state T 2 . The translated coordinates are 
determined according to the original coordinates of two-dimensional image 
960 2 represented by point 970 2 and according to the coordinates of 
trajectory 958 (i.e., those which are represented by points 968^ 968 2 , 968 3 
and 968 4 ). 
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In procedure 1004, the auxiliary two-dimensional image is 
associated with the selected activity-state, according to the translated 
coordinates. With reference to Figure 25B, processor 460 associates two- 
dimensional image 960 2 with activity-state T 1f as translated two- 
dimensional image 960 2T , according to the translated coordinates 
represented by point 970 2T . At this point the method recursively returns 
back to procedure 1 002, until the auxiliary two-dimensional images of all 
activity-states other than the selected activity-states, are associated with 
the selected activity-state. With reference to Figure 25C, two-dimensional 
images 960^ 960 3 , 960 4 , which belong to activity-state T 2 and two- 
dimensional images 964^ 964 2 , 964 3 , 964 4 and 964 5 , which belong to 
activity-state T 3 , are associated with activity-state T u as translated two- 
dimensional images 960 1T , 960 3T , 960 4T , 964 1T , 964 2T , 964 3T , 964 4T and 
964 5T . The translated coordinates of these translated two-dimensional 
images are represented by points 970 1T , 970 3T , 970 4T , 972 1T , 972 2T , 972 3T , 
972 4T and 972 5T , respectively. 

In procedure 1006, the three-dimensional image is 
reconstructed. With reference to Figure 25C, processor 460 reconstructs 
three-dimensional image 974 from two-dimensional images 956^ 956 2 , 
956 3 and 956 4 and from auxiliary two-dimensional images 960 1? 960 2 , 
960 3 , 960 4 , 964 1f 964 2 , 964 3 , 964 4 and 964 5 . 

Reference is now made to Figures 27A and 27B. Figure 27A is 
an illustration of a section of a vessel, generally referenced 1030, which 
includes a plurality of branches. Vessel 1030 can be a section of an artery, 
vein, bronchus, and the like, which includes a plurality of bifurcations. 
Figure 27B is a schematic illustration of a graphical user interface (GUI), 
generally referenced 1060, constructed and operative according to another 
embodiment of the disclosed technique. 

With reference to Figure 27A, vessel 1030 includes side 
branches 1032, 1034 and 1036, and two main branches 1038 and 1040. 
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Side branches 1032, 1034 and 1036 branch out from vessel 1030 at 
branching regions 1042, 1044 and 1046, respectively. 

With reference to Figure 27B, GUI 1060 includes a window 
1062. Window 1062 includes a three-dimensional image 1064 of vessel 
1030. Three-dimensional image 1064 includes a main section 1066, 
branches 1068 and 1070, a plurality of openings 1072, 1074 and 1076, a 
plurality of marks 1078, 1080 and 1082, a trajectory 1084 and a 
representation of a surgical tool 1086. Main section 1066 represents 
vessel 1030. Branches 1068 and 1070 represent main branches 1038 and 
1040, respectively. 

Processor 460 (Figure 15A) reconstructs three-dimensional 
image 1064 during a scanning process in which the operator scans vessel 
1030 and main branches 1038 and 1040, by employing an imaging 
catheter, such as imaging catheter 452. While the imaging catheter moves 
inside vessel 1030 and passes branching regions 1042, 1044 and 1046, 
the image detector of the imaging catheter, such as image detector 470 
detects branching regions 1042, 1044 and 1046 as a plurality of openings 
in the wall of vessel 1030. 

GUI 1060 displays branching regions 1042, 1044 and 1046, as 
openings 1072, 1074 and 1076, respectively. GUI 1060 further displays 
marks 1078, 1080 and 1082 in the vicinity of openings 1072, 1074 and 
1076, respectively, as an indication of branching regions 1042, 1044 and 
1046, respectively. Each of marks 1078, 1080 and 1082 can be a polygon, 
closed curve, open curve, straight line with an end, straight line without an 
end, different colors, animation, and the like. 

Trajectory 1084 indicates one of the paths which the imaging 
catheter followed inside vessel 1030 during the scanning process. 
Representation 1086 represents the location and orientation of a surgical 
tool inside vessel 1030, such as surgical tool 486 (Figure 16A). By 
employing GUI 1060, the operator can navigate the surgical tool through 
vessel 1030, to selected side branches of vessel 1030 during a surgical 
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procedure. It is noted that the system can derive various representations, 
according to the reconstructed model of the inspected organ, such as an 
internal model, a quantitative model superposed on a real-time acquired 
image, and the like. 

5 It will be appreciated by persons skilled in the art that the 

disclosed technique is not limited to what has been particularly shown and 
described herein above. Rather the scope of the disclosed technique is 
defined only by the claims, which follow. 
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CLAIMS 

1 . Medical imaging and navigation system comprising: 

a processor, coupled with a display unit and to a database; 

a medical positioning system (MPS), coupled with said 
processor, including a transducer MPS sensor and a surgical tool 
MPS sensor, said surgical tool MPS sensor being firmly attached to a 
surgical tool; 

a two-dimensional imaging system, coupled with said processor, 
including an imaging transducer, said transducer MPS sensor being 
firmly attached to said imaging transducer; 

an inspected organ monitor interface, coupled with said 
processor and to an organ monitor, said organ monitor monitoring an 
organ timing signal associated with an inspected organ; and 

a superimposing processor, coupled with said processor. 

2. The system according to claim 1 , wherein said processor receives: 

a plurality of two-dimensional images from said two-dimensional 
imaging system, acquired by said imaging transducer; 

the location and orientation of said imaging transducer from said 
medical positioning system, as detected by said transducer MPS 
sensor, for each said two-dimensional images; 

said organ timing signal from said inspected organ monitor 
interface, as detected by said organ monitor, for each said two- 
dimensional images; and 

the location and orientation of said surgical tool, from said 
medical positioning system, as detected by said surgical tool MPS 
sensor. 
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3. The system according to claim 2, wherein said location and 
orientation of said surgical tool and said location and orientation of 
said imaging transducer, reside in a single coordinate system. 

4. The system according to claim 3, wherein for each said two- 
dimensional images, said processor stores said two-dimensional 
image in said database together with said location and orientation 
information of said imaging transducer, respective of said two- 
dimensional image and said organ timing signal, respective of said 
two-dimensional image, 

wherein said processor selects at least one of said stored two- 
dimensional images, having a stored organ timing signal substantially 
equal to a real time detected organ timing signal, 

wherein said superimposing processor superimposes a 
representation of said surgical tool on a visual representation of said 
selected two-dimensional images, and 

wherein said display presents the result of said superimposing. 

5. The system according to claim 4, wherein said visual representation 
is a three-dimensional reconstructed image produced from said 
selected two-dimensional images, according to the location and 
orientation information of said imaging transducer associated with 
each said selected two-dimensional images. 

6. The system according to claim 5, wherein a renderer renders said 
visual representation according to reference coordinates. 

7. The system according to claim 6, wherein said reference coordinates 
are selected from the list consisting of: 

surgical tool coordinates; 
inspected organ coordinates; and 
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coordinates of the body of the patient. 

8. The system according to claim 4, wherein said visual representation 
is two-dimensional. 

9. The system according to claim 8, wherein said representation of said 
surgical tool comprises a projection of a three-dimensional 
representation of said representation of said surgical tool, on said 
two-dimensional visual representation. 

10. The system according to claim 4, wherein said representation of said 
surgical tool indicates an estimated location of said surgical tool. 

1 1 . The system according to claim 4, wherein said representation of said 
surgical tool indicates the orientation of said surgical tool. 

12. The system according to claim 4, wherein portions of said surgical 
tool which are located above, below and within a viewed plane, are 
presented in different colors. 

13. The system according to claim 4, wherein said representation of said 
surgical tool is in the form of a cursor. 

14. The system according to claim 4, wherein said representation of said 
surgical tool is a pseudo realistic visualization of said surgical tool. 

15. The system according to claim 4, wherein said visual representation 
is a three-dimensional reconstruction produced from said selected 
two-dimensional images, according to the location and orientation 
information of said imaging transducer associated with said selected 

-81- 



WO 02/064011 



PCT/1L02/00108 



two-dimensional images, discarding portions in said selected two- 
dimensional images which represent said surgical tool. 

16. The system according to claim 1, wherein said database is 
volumetric. 

17. The system according to claim 1, wherein said display includes 
goggles. 

18. The system according to claim 17, wherein said goggles are semi- 
transparent. 

19. The system according to claim 4, wherein said medical positioning 
system further includes a goggles MPS sensor, 

wherein said display includes semi-transparent goggles, being 
attached to said goggles MPS sensor, and 

wherein said processor selects a viewing plane for said visual 
representation, according to the location and orientation information 
received from said goggles MPS sensor. 

20. The system according to claim 19, wherein said location and 
orientation of said goggles MPS sensor is provided within said 
coordinate system. 

21. The system according to claim 1, wherein said two-dimensional 
imaging system is selected from the list consisting of: 

ultra-sound; 

inner-vascular ultra-sound; 
X-ray; 

nuclear magnetic resonance; 
computerized tomography; 
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positron-emission tomography; and 
single-photon-emission tomography. 

22. The system according to claim 1, wherein said surgical tool is 
selected from the list consisting of: 

clamp; 

laser cutter; 

brush; 

catheter; 

stent; 

balloon; 

pace maker electrode; 
solution dispensing unit; 
neuron electrode; 
substance collection unit; 
surgical delivery tool; 
gene delivery tool; 
drug delivery tool; and 
device delivery tool. 

23. The system according to claim 1, wherein said medical positioning 
system further includes a body MPS sensor, for attaching to the body 
of the patient. 

24. Medical imaging and navigation system comprising: 

a processor, coupled with a display unit and to a database; 

a medical positioning system (MPS), coupled with said 
processor, including a surgical tool MPS sensor being firmly attached 
to a surgical tool; 
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an inspected organ monitor interface, coupled with said 
processor and to an organ monitor, said organ monitor monitoring an 
organ timing signal associated with an inspected organ; and 

a superimposing processor, coupled with said processor. 

25. The system according to claim 24, wherein said processor receives: 

said organ timing signal from said inspected organ monitor 
interface, as detected by said organ monitor; and 

the location and orientation of said surgical tool, from said 
medical positioning system, as detected by said surgical tool MPS 
sensor. 

26. The system according to claim 25, wherein said processor selects 
images from said database, each said selected images having a 
stored organ timing signal substantially equal to a real-time detected 
organ timing signal, 

wherein said superimposing processor superimposes a 
representation of said surgical tool on said selected images, and 
wherein said display presents the result of said superimposing. 

27. The system according to claim 26, wherein said selected images are 
three-dimensional. 

28. The system according to claim 26, wherein said selected images are 
two-dimensional. 

29. The system according to claim 28, wherein said representation of 
said surgical tool comprises a projection of a three-dimensional 
representation of said representation of said surgical tool, on said 
two-dimensional images. 
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30. The system according to claim 24, wherein said database is 
volumetric. 

31- The system according to claim 24, wherein said database is further 
coupled to an image acquisition system. 

32. The system according to claim 24, wherein said display includes 
goggles. 

33. The system according to claim 32, wherein said goggles are semi- 
transparent. 

34. The system according to claim 26, wherein said medical positioning 
system further includes a goggles MPS sensor, 

wherein said display includes semi-transparent goggles, being 
attached to said goggles MPS sensor, and 

wherein said processor selects a viewing plane for said visual 
representation, according to the location and orientation information 
received from said goggles MPS sensor. 

35. The system according to claim 34, wherein said location and 
orientation information of said goggles MPS sensor is provided within 
the coordinate system of said surgical tool MPS sensor. 

36. The system according to claim 34, wherein said location and 
orientation information of said goggles MPS sensor is provided within 
the coordinate system of said selected images. 

37. The system according to claim 24, wherein said two-dimensional 
imaging system is selected from the list consisting of: 

ultra-sound; 
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inner-vascular ultra-sound; 
X-ray; 

nuclear magnetic resonance; 
computerized tomography; 
positron-emission tomography; and 
single-photon-emission tomography. 

38. The system according to claim 24, wherein said surgical tool is 
selected from the list consisting of: 

clamp; 

laser cutter; 

brush; 

catheter; 

stent; 

balloon; 

pace maker electrode; 
solution dispensing unit; 
neuron electrode; 
substance collection unit; 
surgical delivery tool; 
gene delivery tool; 
drug delivery tool; and 
device delivery tool. 

39. The system according to claim 24, wherein said medical positioning 
system further includes a body MPS sensor, for attaching to the body 
of the patient. 

40. Method for displaying an image sequence of a moving inspected 
organ, the method comprising the procedures of: 
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detecting an organ timing signal of said inspected organ, said 
organ timing signal defining an organ timing signal cycle; 

detecting a plurality of two-dimensional images of said inspected 
organ, using an image detector; 

detecting the location and orientation of said image detector; 

associating each of said two-dimensional images with said 
image detector location and orientation and with said detected organ 
timing signal; 

reconstructing a plurality of three-dimensional images from said 
two-dimensional images, each said three-dimensional images being 
reconstructed from two-dimensional images selected from said two- 
dimensional images, said selected two-dimensional images 
corresponding to a selected position within said organ timing signal 
cycle; 

selecting one of said three-dimensional images according to a 
real-time reading of said organ timing signal; and 

displaying said selected three-dimensional image. 

41 . The method according to claim 40, further comprising the following 
procedures prior to said procedure of reconstructing: 

detecting the location and orientation of a surgical tool; and 
modifying at least one of said two-dimensional images, by 
discarding a portion of at least one of said two-dimensional images, 
said portion representing at least a portion of said surgical tool. 

42. The method according to claim 41, wherein said detected location 
and orientation of said surgical tool and said detected location and 
orientation of said image detector, both reside in a single coordinate 
system. 
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43. The method according to claim 41 , further comprising the procedure 
of superimposing a representation of said surgical tool onto said 
selected three-dimensional image, prior to said procedure of 
displaying. 

44. The method according to claim 40, further comprising the following 
procedures, prior to said procedure of displaying: 

detecting the location and orientation of a surgical tool; and 
superimposing a representation of said surgical tool onto said 

selected three-dimensional image, according to said detected 

location and orientation of said surgical tool. 

45. The method according to claim 40, further comprising the following 
procedures prior to said procedure of displaying: 

detecting the location and orientation of a surgical tool; and 
superimposing a representation of said detected location and 

orientation of said surgical tool, onto said selected three-dimensional 

image. 

46. The method according to claim 40, further comprising, the following 
procedures, after said procedure of selecting: 

detecting the location and orientation of a point of view of a user; 

and 

rendering said selected three-dimensional image according to 
said detected location and orientation of said point of view. 

47. The method according to claim 46, further comprising the following 
procedures prior to said procedure of rendering: 

detecting the location and orientation a surgical tool; and 
superimposing a representation of said surgical tool onto said 
selected three-dimensional image. 
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48. The method according to claim 46, further comprising the following 
procedures, prior to said procedure of rendering: 

detecting the location and orientation of a surgical tool; and 
superimposing a representation of said detected location and 

orientation of said surgical tool onto said selected three-dimensional 

image. 

49. The method according to claim 46, wherein said procedure of 
detecting said location and orientation of said point of view of said 
user, is performed using a location and orientation sensor attached to 
user worn goggles. 

50. The method according to claim 46, wherein said procedure of 
detecting said location and orientation of said point of view of said 
user, is performed using a location and orientation sensor attached to 
user worn semi-transparent goggles. 

51 . The method according to claim 49, wherein the information respective 
of said location and orientation sensor is provided within the 
coordinate system of a surgical tool. 

52. The method according to claim 49, wherein the information respective 
of said location and orientation sensor is provided within the 
coordinate system of said inspected organ. 

53. The method according to claim 49, wherein the information respective 
of said location and orientation sensor is provided within the 
coordinate system of the body of the patient. 
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54. The method according to claim 41, wherein said surgical tool is 
selected from the list consisting of: 

clamp; 

laser cutter; 

brush; 

catheter; 

stent; 

balloon; 

pace maker electrode; 
solution dispensing unit; 
neuron electrode; 
substance collection unit; 
surgical delivery tool; 
gene delivery tool; 
drug delivery tool; and 
device delivery tool. 

55. The method according to claim 43, wherein said representation of 
said surgical tool indicates an estimated location of said surgical tool. 

56. The method according to claim 43, wherein said representation of 
said surgical tool indicates the orientation of said surgical tool. 

57. The method according to claim 43, wherein portions of said surgical 
tool which are located above, below and within a viewed plane, are 
presented in different colors. 

58. The method according to claim 43, wherein said representation of 
said surgical tool is in the form of a cursor. 
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59. The method according to claim 43, wherein said representation of 
said surgical tool is a pseudo realistic visualization of said surgical 
tool. 

60. The method according to claim 40, wherein said procedure of 
reconstruction is performed according to the location and orientation 
information associated with each said selected two-dimensional 
images. 

61. The method according to claim 40, further comprising the procedure 
of discarding portions in said selected two-dimensional images which 
represent a surgical tool, prior to said procedure of reconstructing. 

62. The method according to claim 43, wherein said representation of 
said surgical tool comprises a projection of a three-dimensional 
representation of said representation of said surgical tool, on each of 
said two-dimensional images. 

63. Method for displaying an image sequence of a moving inspected 
organ, the method comprising the procedures of: 

detecting an organ timing signal of said inspected organ, said 
organ timing signal defining an organ timing signal cycle; 

selecting one of a previously stored three-dimensional images 
according to a real-time reading of said organ timing signal; 

detecting the location and orientation of a surgical tool; 

superimposing a representation of said surgical tool onto said 
selected three-dimensional image; and 

displaying said superimposed three-dimensional image. 

64. The method according to claim 63, further comprising the following 
procedures prior to said procedure of selecting: 
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detecting a plurality of two-dimensional images of said inspected 
organ, using an image detector; 

detecting the location and orientation of said image detector; 

associating each of said two-dimensional images with said 
location and orientation of said two-dimensional image and with a 
reading of said organ timing signal detected at the time of acquiring 
said two-dimensional image; and 

reconstructing a plurality of three-dimensional images from said 
two-dimensional images, each said three-dimensional images being 
reconstructed from two-dimensional images selected from said two- 
dimensional images, said selected two-dimensional images 
corresponding to a selected position within said organ timing signal 
cycle. 

65. The method according to claim 64, wherein said detected location 
and orientation of said surgical tool and said detected location and 
orientation of said image detector, both reside in a single coordinate 
system. 

66. The method according to claim 64, further comprising a procedure of 
modifying at least one of said two-dimensional images, by discarding 
a portion thereof which represents at least a portion of said surgical 
tool, wherein said procedure of modifying is performed following said 
procedure of associating, and following said procedure of detecting 
said surgical tool location and orientation. 

67. The method according to claim 63, further comprising the following 
procedures, before said procedure of displaying: 

detecting the location and orientation of a point of view of a user; 

and 
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rendering said selected three-dimensional image according to 
said detected location and orientation of said point of view. 

68. The method according to claim 67, wherein said procedure of 
detecting said location and orientation of said point of view of said 
user, is performed using a location and orientation sensor attached to 
user worn goggles. 

69. The method according to claim 67, wherein said procedure of 
detecting said location and orientation of said point of view of said 
user, is performed using a location and orientation sensor attached to 
user worn semi-transparent goggles. 

70. The method according to claim 68, wherein the information respective 
of said location and orientation sensor is provided within the 
coordinate system of said surgical tool. 

71 . The method according to claim 68, wherein the information respective 
of said location and orientation sensor is provided within the 
coordinate system of said inspected organ. 

72. The method according to claim 68, wherein the information respective 
of said location and orientation sensor is provided within the 
coordinate system of the body of the patient. 

73. The method according to claim 63, wherein said surgical tool is 
selected from the list consisting of: 

clamp; 
laser cutter; 
brush; 
catheter; 
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stent; 
balloon; 

pace maker electrode; 
solution dispensing unit; 
neuron electrode; 
substance collection unit; 
surgical delivery tool; 
gene delivery tool; 
drug delivery tool; and 
device delivery tool. 



74. The method according to claim 63, wherein said representation of 
said surgical tool indicates an estimated location of said surgical tool. 

75. The method according to claim 63, wherein said representation of 
said surgical tool indicates the orientation of said surgical tool. 

76. The method according to claim 63, wherein portions of said surgical 
tool which are located above, below and within a viewed plane, are 
presented in different colors. 

77. The method according to claim 63, wherein said representation of 
said surgical tool is in the form of a cursor. 

78. The method according to claim 63, wherein said representation of 
said surgical tool is a pseudo realistic visualization of said surgical 
tool. 



79. The method according to claim 63, wherein said procedure of 
reconstruction is performed according to the location and orientation 
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information associated with each said selected two-dimensional 
images. 

80. The method according to claim 63, further comprising the procedure 
of discarding portions in said selected two-dimensional images which 
represent said surgical tool, prior to said procedure of reconstructing. 

81. The method according to claim 64, wherein said representation of 
said surgical tool comprises a projection of a three-dimensional 
representation of said representation of said surgical tool, on each of 
said two-dimensional images. 

82. Method for displaying an image sequence of a moving inspected 
organ, the method comprising the procedures of: 

detecting an organ timing signal of said inspected organ, said 
organ timing signal defining an organ timing signal cycle; 

detecting the location and orientation of a point of view of a user; 

selecting one of a previously stored three-dimensional images 
according to a real-time reading of said organ timing signal; 

rendering said selected three-dimensional image according to 
said detected location and orientation of said point of view; and 

displaying said selected three-dimensional image. 

83. The method according to claim 82, further comprising the following 
procedures prior to said procedure of selecting: 

detecting a plurality of two-dimensional images of said inspected 
organ, using an image detector; 

detecting the location and orientation of said image detector; 

associating each of said two-dimensional images with said 
location and orientation of said two-dimensional image and with a 
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reading of said organ timing signal detected at the time of acquiring 
said two-dimensional image; and 

reconstructing a plurality of three-dimensional images from said 
two-dimensional images, each said three-dimensional images being 
reconstructed from two-dimensional images selected from said two- 
dimensional images, said selected two-dimensional images 
corresponding to a selected position within said organ timing signal 
cycle. 

84. The method according to claim 83, further comprising the following 
procedures prior to said procedure of reconstructing: 

detecting the location and orientation of a surgical tool; and 
modifying at least one of said two-dimensional images, by 
discarding a portion of at least one of said two-dimensional images, 
said portion representing at least a portion of said surgical tool. 

85. The method according to claim 84, wherein said detected location 
and orientation of said surgical tool and said detected location and 
orientation of said image detector, both reside in a single coordinate 
system. 

86. The method according to claim 84, further comprising the procedure 
of superimposing a representation of said surgical tool onto said 
selected three-dimensional image, prior to said procedure of 
displaying. 

87. The method according to claim 83, further comprising the following 
procedures, after said procedure of associating: 

detecting the location and orientation of a surgical tool; 
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modifying at least one of said two-dimensional images, by 
discarding a portion of at least one of said two-dimensional images, 
which represents said surgical tool; and 

superimposing a representation of said surgical tool onto said 
selected three-dimensional image. 

88. The method according to claim 82, wherein said procedure of 
detecting said location and orientation of said point of view of said 
user, is performed using a location and orientation sensor attached to 
user worn goggles. 

89. The method according to claim 82, wherein said procedure of 
detecting said location and orientation of said point of view of said 
user, is performed using a location and orientation sensor attached to 
user worn semi-transparent goggles. 

90. The method according to claim 88, wherein the information respective 
of said location and orientation sensor is provided within the 
coordinate system of a surgical tool. 

91 . The method according to claim 88, wherein the information respective 
of said location and orientation sensor is provided within the 
coordinate system of said inspected organ. 

92. The method according to claim 88, wherein the information respective 
of said location and orientation sensor is provided within the 
coordinate system of the body of the patient. 

93. The method according to claim 84, wherein said surgical tool is 
selected from the list consisting of: 

clamp; 
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laser cutter; 

brush; 

catheter; 

stent; 

balloon; 

pace maker electrode; 
solution dispensing unit; 
neuron electrode; 
substance collection unit; 
surgical delivery tool; 
gene delivery tool; 
drug delivery tool; and 
device delivery tool. 



94. The method according to claim 86, wherein said representation of 
said surgical tool indicates an estimated location of said surgical tool. 

95. The method according to claim 86, wherein said representation of 
said surgical tool indicates the orientation of said surgical tool. 

96. The method according to claim 86, wherein portions of said surgical 
tool which are located above, below and within a viewed plane, are 
presented in different colors. 

97. The method according to claim 86, wherein said representation of 
said surgical tool is in the form of a cursor. 

98. The method according to claim 86, wherein said representation of 
said surgical tool is a pseudo realistic visualization of said surgical 
tool. 



-98- 



WO 02/064011 



PCT/1L02/00108 



99. The method according to claim 83, further comprising the procedure 
of discarding portions in said selected two-dimensional images which 
represent a surgical tool, prior to said procedure of reconstructing. 

100. The method according to claim 86, wherein said representation of 
said surgical tool comprises a projection of a three-dimensional 
representation of said representation of said surgical tool, on each of 
said two-dimensional images. 

101. Method for displaying an image sequence of a moving inspected 
organ, each image in said image sequence being associated with the 
location and orientation thereof within a predetermined coordinate 
system, the method comprising the procedures of: 

detecting an organ timing signal of said inspected organ; 
selecting one of a previously stored two-dimensional images 
according to a real-time reading of said organ timing signal; and 
displaying said selected two-dimensional image. 

102. The method according to claim 101, further comprising the following 
procedures, before said procedure of displaying: 

detecting the location and orientation of a surgical tool; and 
projecting a representation of said surgical tool onto said 
selected two-dimensional image. 

103. The method according to claim 101, further comprising the 
preliminary procedures of: 

detecting a plurality of two-dimensional images of said inspected 
organ, using an image detector; and 

detecting the location and orientation of said image detector for 
each said two-dimensional images. 
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104. The method according to claim 102, further comprising the 
preliminary procedures of: 

detecting a plurality of two-dimensional images of said inspected 
organ, using an image detector; and 

detecting the location and orientation of said image detector. 

105. The method according to claim 104, further comprising the 
preliminary procedure of storing said two-dimensional images and the 
respective said detected locations and orientations of said image 
detector, in a database. 

106. The method according to claim 103, further comprising the 
preliminary procedures of: 

determining if at least one of said two-dimensional images 
deviates from a selected plane; and 
reporting said deviation. 

107. The method according to claim 101, further comprising the procedure 
of detecting the location and orientation of a point of view of a user, 
before said procedure of displaying, wherein said stored two- 
dimensional image is selected according to said detected location 
and orientation of said point of view. 

108. The method according to claim 107, further comprising the 
preliminary procedures of: 

detecting a plurality of two-dimensional images of said inspected 
organ, using an image detector; 

detecting the location and orientation of said image detector, 
respective of each of said two-dimensional images; and 
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storing said two-dimensional images and the respective said 
detected locations and orientations of said image detector, in a 
database. 

109. The method according to claim 107, wherein said procedure of 
detecting said location and orientation of said point of view of said 
user, is performed using a location and orientation sensor attached to 
user worn goggles. 

110. The method according to claim 104, wherein said detected location 
and orientation of said surgical tool and said detected location and 
orientation of said image detector, both reside in a single coordinate 
system. 

111. The method according to claim 109, wherein the information 
respective of said location and orientation sensor is provided within 
the coordinate system of a surgical tool. 

112. The method according to claim 109, wherein the information 
respective of said location and orientation sensor is provided within 
the coordinate system of said inspected organ. 

11 3. The method according to claim 109, wherein the information 
respective of said location and orientation sensor is provided within 
the coordinate system of the body of the patient. 

114. The method according to claim 102, wherein said surgical tool is 
selected from the list consisting of: 

clamp; 
laser cutter; 
brush; 
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catheter; 

stent; 

balloon; 

pace maker electrode; 
solution dispensing unit; 
neuron electrode; 
substance collection unit; 
surgical delivery tool; 
gene delivery tool; 
drug delivery tool; and 
device delivery tool. 



115. The method according to claim 102, wherein said representation of 
said surgical tool indicates an estimated location of said surgical tool. 

116. The method according to claim 102, wherein said representation of 
said surgical tool indicates the orientation of said surgical tool. 

117. The method according to claim 102, wherein portions of said surgical 
tool which are located above, below and within said selected two- 
dimensional image, are presented in different colors. 

118. The method according to claim 102, wherein said representation of 
said surgical tool is in the form of a cursor. 

119. The method according to claim 102, wherein said representation of 
said surgical tool is a pseudo realistic visualization of said surgical 
tool. 



120. Medical imaging and navigation system comprising: 

a processor, coupled to a display unit and to a database; 
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a medical positioning system (MPS), coupled to said processor, 
including an imaging MPS sensor, said imaging MPS sensor being 
firmly attached to an image detector; 

a two-dimensional imaging system, coupled to said processor, 
including said image detector, said image detector being firmly 
attached to an imaging catheter; and 

an inspected organ monitor interface, coupled to said processor 
and to an organ monitor, said organ monitor monitoring an organ 
timing signal associated with an inspected organ. 

121 . The system according to claim 120, wherein said processor receives: 

a plurality of two-dimensional images from said two-dimensional 
imaging system, acquired by said image detector; 

location and orientation information associated with said image 
detector from said medical positioning system, as detected by said 
imaging MPS sensor, for each said two-dimensional images; and 

organ timing signal from said inspected organ monitor interface, 
as detected by said organ monitor, for each said two-dimensional 
images. 

122. The system according to claim 121, wherein for each of said two- 
dimensional images, said processor associates said two-dimensional 
image with said location and orientation information of said image 
detector, respective of said two-dimensional image and with said 
detected organ timing signal, respective of said two-dimensional 
image. 

123. The system according to claim 121, wherein said processor stores 
said two-dimensional image, said associated location and orientation 
information associated with said image detector and said detected 
organ timing signal, in said database. 
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124. The system according to claim 122, wherein said processor selects at 
least one of said two-dimensional images, and said display unit 
presents a visual representation of said selected at least one two- 
dimensional images. 

125. The system according to claim 124, wherein said visual 
representation is a three-dimensional reconstructed image produced 
from said selected at least one two-dimensional images, according to 
the location and orientation information of said image detector, and 
according to said detected organ timing signal, associated with each 
of said selected at least one two-dimensional images. 

126. The system according to claim 125, wherein said three-dimensional 
reconstructed image is a quantitative model of said inspected organ. 

127. The system according to claim 125, wherein said processor enables 
manual correction of said three-dimensional reconstructed image. 

128. The system according to claim 125, wherein said three-dimensional 
reconstructed image is semi-transparent. 

129. The system according to claim 124, wherein said visual 
representation is two-dimensional. 

130. The system according to claim 124, wherein said detected organ 
timing signal respective of each of said selected at least one two- 
dimensional images, is substantially equal to a real time detected 
organ timing signal. 
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131. The system according to claim 124, wherein said processor 
computes at least one trajectory of said imaging catheter within said 
inspected organ, each said at least one trajectory is computed 
according to location and orientation information respective of a 
specific activity-state within said detected organ timing signal. 

132. The system according to claim 131 , wherein for each activity state of 
said detected organ timing signal, said processor superimposes the 
respective one of said at least one trajectory on the respective one of 
said visual representations. 

133. The system according to claim 131, wherein said processor selects 
said at least one computed trajectory according to a real time 
detected organ timing signal, 

wherein said processor superimposes a representation of said 
selected at least one computed trajectory on said visual 
representation, and 

wherein the result of said superimposition it to be presented by 
said display. 

134. The system according to claim 133, wherein said processor selects a 
portion of said selected at least one computed trajectory according to 
a real time detected location and orientation of a surgical catheter. 

135. The system according to claim 134, wherein said surgical catheter 
comprises an interventional catheter and a surgical tool. 

136. The system according to claim 135, wherein said surgical tool is 
selected from the list consisting of: 

clamp; 
laser cutter; 
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brush; 
catheter; 
stent; 
balloon; 

pace maker electrode; 
solution dispensing unit; 
neuron electrode; 
substance collection unit; 
surgical delivery tool; 
endoscope; 
gene delivery tool; 
drug delivery tool; 
device delivery tool; 
ablation catheter; 

electrophysiological mapping device; imaging device; and 
a combination thereof. 



137. The system according to claim 124, wherein a renderer renders said 
visual representation according to reference coordinates. 

138. The system according to claim 136, wherein said reference 
coordinates are selected from the list consisting of: 

image detector coordinates; 
inspected organ coordinates; and 
coordinates of the body of the patient. 

139. The system according to claim 120, wherein said database is 
volumetric. 



140. The system according to claim 120, wherein said processor produces 
an alarm signal, when said processor detects that the travel speed of 
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said imaging catheter within said inspected organ, is greater than a 
predetermined value. 

141. The system according to claim 139, wherein said alarm signal is 
selected from the list consisting of: 

audio; 
visual; and 
tactile. 

142. The system according to claim 120, wherein said image detector is 
selected from the list consisting of: 

thermographic imaging element; 

optical coherence tomography imaging element; 

intravascular ultrasound transducer; 

intracardiac ultrasound transducer; 

any ultrasound transducer attached to an endoscope; and 

magnetic resonance imaging element. 

143. The system according to claim 120, wherein said medical positioning 
system further includes a body MPS sensor, for attaching to the body 
of the patient. 

144. The system according to claim 120, wherein said display unit is 
selected from the list consisting of: 

two-dimensional display; 
auto-stereoscopic display; and 
goggles. 

145. The system according to claim 143, wherein said goggles are semi- 
transparent. 
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146. The system according to claim 124, wherein said medical positioning 
system further includes a goggles MPS sensor, 

wherein said display unit includes semi-transparent goggles, 
being attached to said goggles MPS sensor, and 

wherein said processor selects a viewing plane for said visual 
representation, according to the location and orientation information 
received from said goggles MPS sensor. 

147. The system according to claim 145, wherein said location and 
orientation of said goggles MPS sensor is provided within the 
coordinate system of said medical positioning system. 

148. The system according to claim 120, wherein said two-dimensional 
imaging system is selected from the list consisting of: 

ultra-sound; 
thermography; 

optical coherence tomography; 
inner-vascular ultra-sound; 
X-ray; 

nuclear magnetic resonance; 
computerized tomography; 
positron-emission tomography; and 
single-photon-emission tomography. 

149. Medical imaging and navigation system comprising: 

a processor, coupled to a display unit and to a database; 

a medical positioning system (MPS), coupled to said processor, 
including a catheter MPS sensor, said catheter MPS sensor being 
firmly attached to a surgical tool, said surgical tool being firmly 
attached to a surgical catheter; and 
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an inspected organ monitor interface, coupled to said processor 
and to an organ monitor, said organ monitor monitoring an organ 
timing signal associated with an inspected organ. 

150. The system according to claim 149, wherein said processor receives: 

said organ timing signal from said inspected organ monitor 
interface, as detected by said organ monitor; and 

location and orientation information associated with said surgical 
tool, from said medical positioning system, as detected by said 
catheter MPS sensor. 

151. The system according to claim 150, wherein said processor retrieves 
images of said inspected organ from said database. 

152. The system according to claim 151, wherein said processor selects 
said at least one reconstructed image, according to said organ timing 
signal. 

153. The system according to claim 152, wherein said processor 
superimposes a visual representation of said surgical tool on said 
selected at least one reconstructed image, according to said location 
and orientation information associated with said surgical tool. 

154. The system according to claim 153, wherein said selected at least 
one reconstructed image is a quantitative model of said inspected 
organ. 

155. The system according to claim 153, wherein said processor enables 
manual correction of said selected at least one reconstructed image. 
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156. The system according to claim 152, wherein said selected at least 
one reconstructed image is semi-transparent. 

157. The system according to claim 152, wherein said processor 
superimposes a trajectory on said selected at least one reconstructed 
image. 

158. The system according to claim 157, wherein said database contains 
a plurality of trajectories stored in said database, each said 
trajectories being associated with an organ timing signal activity state, 
and 

wherein said processor retrieves said trajectory from said 
trajectories, according to the activity state determined from a real- 
time measurement of said organ timing signal. 

159. The system according to claim 158, wherein said processor updates 
said retrieved trajectory according to said location and orientation 
information associated with said surgical tool. 

160. The system according to claim 157, wherein said processor 
computes a at least one trajectory, each said at least one trajectory 
being computed from said location and orientation information 
associated with said surgical tool and respective of a selected activity 
state of said organ timing signal, and 

wherein said processor selects said trajectory from said at least 
one trajectory according to said organ timing signal. 

161. The system according to claim 157, wherein said processor produces 
a predetermined representation for that portion of said trajectory 
which is located behind a point defined by said location and 
orientation information associated with said surgical tool, and 
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wherein said processor produces a different predetermined 
representation for that portion of said trajectory, which is located in 
front of, said point defined by said location and orientation information 
associated with said surgical tool. 

162. The system according to claim 151, wherein said at least one 
reconstructed image is three-dimensional. 

163. The system according to claim 151, wherein said at least one 
reconstructed image is two-dimensional. 

164. The system according to claim 152, wherein the activity-state of an 
organ timing signal associated with said selected at least one 
reconstructed image, is substantially equal to a real time activity-state 
measurement of said organ timing signal. 

165. The system according to claim 158, wherein said organ timing signal 
associated with said selected at least one computed trajectory, is 
substantially equal to a real time detected organ timing signal. 

166. The system according to claim 153, wherein said representation of 
said surgical tool comprises a projection of a three-dimensional 
representation of said representation of said surgical tool, on said 
selected at least one reconstructed image. 

167. The system according to claim 153, wherein said visual 
representation of said surgical tool comprises a projection of a three- 
dimensional representation of said representation of said surgical 
tool, on said selected at least one reconstructed image. 
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168. The system according to claim 153, wherein said representation of 
said surgical tool indicates an estimated location of said surgical tool. 

169. The system according to claim 153, wherein said representation of 
said surgical tool indicates the orientation of said surgical tool. 

170. The system according to claim 153, wherein portions of said surgical 
tool which are located above, below and within a viewed plane, are 
presented in different colors. 

171. The system according to claim 153, wherein said representation of 
said surgical tool is in the form of a cursor. 

172. The system according to claim 153, wherein said representation of 
said surgical tool is a pseudo realistic visualization of said surgical 
tool. 

173. The system according to claim 152, wherein said selected at least 
one reconstructed image is a three-dimensional image reconstructed 
from said selected two-dimensional images, according to said 
location and orientation information associated with said surgical tool 
and with said selected two-dimensional images, discarding portions in 
said selected two-dimensional images which represent said surgical 
tool. 

174. The system according to claim 152, wherein a renderer renders said 
selected at least one reconstructed image according to reference 
coordinates. 

175. The system according to claim 174, wherein said reference 
coordinates are selected from the list consisting of: 
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surgical tool coordinates; 
inspected organ coordinates; and 
coordinates of the body of the patient. 

176. The system according to claim 149, wherein said database is 
volumetric. 

177. The system according to claim 149, wherein said medical positioning 
system further includes a body MPS sensor, for attaching to the body 
of the patient. 

178. The system according to claim 149, wherein said display unit is 
selected from the list consisting of: 

two-dimensional display; 
auto-stereoscopic display; and 
goggles. 

179. The system according to claim 178, wherein said goggles are semi- 
transparent. 

180. The system according to claim 152, wherein said medical positioning 
system further includes a goggles MPS sensor, 

wherein said display unit includes semi-transparent goggles, 
being attached to said goggles MPS sensor, and 

wherein said processor selects a viewing plane for said selected 
at least one reconstructed image, according to the location and 
orientation information received from said goggles MPS sensor. 

181. The system according to claim 180, wherein said location and 
orientation of said goggles MPS sensor is provided within the 
coordinate system of said medical positioning system. 
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182. The system according to claim 149, wherein said surgical tool is 
selected from the list consisting of: 

clamp; 

laser cutter; 

brush; 

catheter; 

stent; 

balloon; 

pace maker electrode; 
solution dispensing unit; 
neuron electrode; 
substance collection unit; 
surgical delivery tool; 
gene delivery tool; 
drug delivery tool; 
device delivery tool; 
ablation catheter; 
endoscope; 

electrophysiological mapping device; 
imaging device; and 
a combination thereof. 

183. The system according to claim 157, further comprising a real-time 
imaging system coupled to said processor, wherein said processor 
receives real-time image data respective of a portion of the patient, 
said portion includes said inspected organ, and 

wherein said display unit displays a real-time image of said 
portion. 
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184. The system according to claim 183, wherein said real-time imaging 
system is selected from the list consisting of: 

fluoroscopic; 
X-ray; 

Ultrasound; and 

Magnetic Resonance Imaging. 

185. The system according to claim 183, wherein said processor selects 
said at least one reconstructed image, according to the activity state 
of a real-time measurement of said organ timing signal. 

186. The system according to claim 185, wherein said processor 
superimposes a representation of said selected at least one 
reconstructed image on said real-time image, according to the 
location and orientation of said real-time imaging system and 
according to the location and orientation of said inspected organ. 

187. The system according to claim 186, wherein said processor selects 
one of a plurality of computed trajectories according to the activity 
state of a real-time measurement of said organ timing signal. 

188. The system according to claim 187, wherein said processor 
superimposes a representation of said selected computed trajectory 
on said real-time image. 

189. The system according to claim 183, wherein said processor 
superimposes a representation of said surgical tool on said real-time 
image, according to said location and orientation information 
associated with said surgical tool. 
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190. The system according to claim 189, wherein said processor produces 
a predetermined representation for that portion of said trajectory 
which is located behind a point defined by said location and 
orientation information associated with said surgical tool, and 

wherein said processor produces a different predetermined 
representation for that portion of said trajectory, which is located in 
front of, said point defined by said location and orientation information 
associated with said surgical tool. 

191. The system according to claim 183, wherein the location of said real- 
time imaging system in the coordinate system of said medical 
positioning system, is determined according to a fixed predetermined 
location, relative to a transmitter coupled to said medical positioning 
system. 

192. The system according to claim 183, wherein the location of said real- 
time imaging system in the coordinate system of said medical 
positioning system, is determined according to the location of an MPS 
sensor coupled to said real-time imaging system. 

193. Graphical user interface comprising a plurality of windows, wherein 
each of said windows presents at least one image of an inspected 
organ, and 

wherein at least a selected one of said at least one image is 
selected according to an organ timing signal. 

194. The graphical user interface according to claim 193, wherein at 
least a portion of at least one of said at least one image is 
reconstructed from a plurality of selected two-dimensional images, 
and 
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wherein said selected two-dimensional images are selected from 
a plurality of two-dimensional images, according to location and 
orientation information associated with said two-dimensional images 
and according to an organ timing signal associated with said two- 
dimensional images. 

195. The graphical user interface according to claim 193, wherein at 
least one of said at least one image is a real time two-dimensional 
image. 

196. The graphical user interface according to claim 193, wherein at 
least one of said at least one image is a reconstructed two- 
dimensional image. 

197. The graphical user interface according to claim 193, wherein at 
least one of said at least one image is an internal three-dimensional 
navigation image. 

198. The graphical user interface according to claim 193, wherein at 
least one of said at least one image is an external three-dimensional 
navigation image. 

199. The graphical user interface according to claim 193, wherein at 
least one of said at least one image is a transverse cross sectional 
image. 

200. The graphical user interface according to claim 193, wherein at 
least one of said at least one image is a longitudinal cross sectional 
image. 
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201. The graphical user interface according to claim 193, wherein at 
least one of said at least one image is semi-transparent. 

202. The graphical user interface according to claim 193, wherein at least 
one of said at least one image is a quantitative model of said 
inspected organ. 

203. The graphical user interface according to claim 193, wherein at 
least one of said windows further comprises a representation of a 
surgical tool superimposed on the respective one of said at least one 
image. 

204. The graphical user interface according to claim 193, wherein at 
least one of said windows further comprises a representation of a 
trajectory of a catheter, superimposed on the respective one of said 
at least one image. 

205. The graphical user interface according to claim 204, wherein a 
portion of said representation of said trajectory located behind the 
location of the tip of a surgical tool, and another portion of said 
representation of said trajectory located in front of said location of 
said tip of said surgical tool, are represented differently. 

206. The graphical user interface according to claim 198, wherein at least 
one of said windows further comprises a projection of said external 
three-dimensional navigation image superimposed on a real time two- 
dimensional image. 

207. The graphical user interface according to claim 206, wherein said at 
least one window further comprises a representation of a trajectory of 
a catheter, superimposed on said real time two-dimensional image. 
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208. The graphical user interface according to claim 207, wherein 
said at least one window further comprises a representation of a 
surgical tool, superimposed on said real time two-dimensional image. 

209. The graphical user interface according to claim 202, wherein at least 
one of said windows further comprises a representation of a trajectory 
of a catheter, superimposed on said real time two-dimensional image. 

210. The graphical user interface according to claim 197, wherein said at 
least one window further comprises a representation of a surgical 
tool, superimposed on said internal three-dimensional navigation 
image. 

211. The graphical user interface according to claim 210, wherein said at 
least one window further comprises a predetermined representation 
for that portion of said trajectory which is located behind a point 
defined by said location and orientation information associated with 
said surgical tool, and a different predetermined representation for 
that portion of said trajectory which is located in front of said point 
defined by said location and orientation information associated with 
said surgical tool. 

212. The graphical user interface according to claim 211, wherein a 
representation of said surgical catheter is superimposed on another 
portion of said internal three-dimensional navigation image, located 
behind said representation of said surgical tool. 

213. The graphical user interface according to claim 193, further 
comprising: 

a graphical representation of said organ timing signal; 
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a forward button, associated with an advancing operation for 
moving forward in time within said organ timing signal; 

a backward button, associated with an rewinding operation for 
moving backward in time within said organ timing signal; and 

a freeze button, associated with a stop operation for halting in 
time within said organ timing signal. 

214. The graphical user interface according to claim 213, wherein said 
windows present said at least one image, corresponding to a selected 
activity-state in said organ timing signal. 

215. The graphical user interface according to claim 199, wherein said at 
least one window further comprises a presentation of information 
respective of the values of a plurality of geometrical parameters of 
said transverse cross sectional image. 

216. The graphical user interface according to claim 200, wherein said at 
least one window further comprises a presentation of information 
respective of the values of a plurality of geometrical parameters of 
said longitudinal cross sectional image. 

217. The graphical user interface according to claim 215, wherein said 
geometrical parameters are selected from the list consisting of: 

diameter of said inspected organ; 

area of said inspected organ; 

percent occlusion of said inspected organ; and 

size of a plaque in said inspected organ. 

218. The graphical user interface according to claim 216, wherein said 
geometrical parameters are selected from the list consisting of: 

diameter of said inspected organ; 
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area of said inspected organ; 

percent occlusion of said inspected organ; and 

size of a plaque in said inspected organ. 

219. The graphical user interface according to claim 215, wherein said 
information is presented in text format. 

220. The graphical user interface according to claim 216, wherein said 
information is presented graphically. 

221. The graphical user interface according to claim 216, wherein said 
information is presented vocally. 

222. The graphical user interface according to claim 193, wherein said 
graphical user interface is displayed via a two-dimensional display. 

223. The graphical user interface according to claim 193, wherein said 
graphical user interface is displayed via an auto-stereoscopic display. 

224. The graphical user interface according to claim 193, wherein said 
inspected organ includes at least one bifurcation, and 

wherein said at least one image includes a bifurcation 
representation respective of said at least one bifurcation. 

225. The graphical user interface according to claim 224, wherein said 
bifurcation representation is selected from the list consisting of: 

polygon; 
closed curve; 
open curve; 

straight line with an end; 
straight line without an end; 
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different colors; and 
animation. 

226. The graphical user interface according to claim 224, wherein at least 
one of said windows further comprises a representation of a trajectory 
of a catheter, superimposed on said bifurcation representation. 

227. Method for displaying at least one occluded region of an inspected 
organ, the method comprising the procedures of: 

comparing a plurality of occlusion values of said inspected 
organ, with a selected occlusion value; 

determining said at least one occluded region according to the 
outcome of said comparison; and 

producing a presentation of said at least one occluded region. 

228. The method according to claim 227, further comprising a preliminary 
procedure of determining saib occlusion values. 

229. The method according to claim 228, further comprising a preliminary 
procedure of receiving said selected occlusion value. 

230. The method according to claim 229, wherein said procedure of 
receiving is performed via a user interface. 

231 . The method according to claim 230, wherein said user interface is 
selected from the list consisting of: 

graphical; 
textual; and 
audio. 
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232. The method according to claim 227, wherein said at least one 
occluded region is determined, when said occlusion values are 
greater than said selected occlusion value. 

233. The method according to claim 227, further comprising a preliminary 
procedure of producing an image of said inspected organ, before said 
procedure of producing a presentation of said at least one occluded 
region. 

234. The method according to claim 233, further comprising a procedure 
of superimposing said representation of said at least one occluded 
region on said image. 

235. The method according to claim 233, wherein said image is a real 
time two-dimensional image. 

236. The method according to claim 233, wherein said image is a 
reconstructed two-dimensional image. 

237. The method according to claim 233, wherein said image is an 
internal three-dimensional navigation image. 

238. The method according to claim 233, wherein said image is an 
external three-dimensional navigation image. 

239. The method according to claim 233, wherein said image is a 
quantitative model of said inspected organ. 

240. The method according to claim 233, wherein said image is manually 
corrected. 
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241. The method according to claim 233, wherein said image is 
reconstructed from a plurality of selected two-dimensional images, 
and 

wherein said selected two-dimensional images are selected from 
a plurality of two-dimensional images, according to location and 
orientation information associated with said two-dimensional images 
and according to an organ timing signal associated with said two- 
dimensional images. 

242. Method for reconstructing an image, the method comprising the 
procedures of: 

determining translated coordinates for an auxiliary two- 
dimensional image, which belongs to an activity-state other than a 
selected activity-state; and 

associating said auxiliary two-dimensional image with said 
selected activity-state, according to said translated coordinates. 

243. The method according to claim 242, further comprising a preliminary 
procedure of selecting said selected activity-state. 

244. The method according to claim 243, further comprising a procedure 
of determining the coordinates of each of a plurality of two- 
dimensional images, which belong to said selected activity-state. 

245. The method according to claim 244, further comprising a procedure 
of determining the coordinates of each of a plurality of auxiliary two- 
dimensional images, which belong to activity-states other than said 
selected activity-state. 

246. The method according to claim 242, further comprising a procedure 
of reconstructing said image. 
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247. The method according to claim 246, further comprising a procedure 
of displaying said reconstructed image. 

248. The method according to claim 246, further comprising a procedure 
of superimposing said reconstructed image on a real time image. 

249. The method according to claim 248, further comprising a procedure 
of displaying the result of said superimposition. 

250. The method according to claim 246, further comprising a procedure 
of selecting one of a plurality of computed trajectories, according to 
said selected activity-state. 

251. The method according to claim 250, further comprising a procedure 
of superimposing a representation of said selected computed 
trajectory on said reconstructed image. 

252. The method according to claim 251 , further comprising a procedure 
of displaying the result of said superimposition. 

253. The method according to claim 250, further comprising a procedure 
of superimposing a representation of a surgical tool on said 
reconstructed image, according to location and orientation 
information associated with said surgical tool. 

254. The method according to claim 253, further comprising a procedure 
of displaying the result of said superimposition. 

255. The method according to claim 253, further comprising the 
procedures of: 
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producing a predetermined representation for that portion of 
said selected computed trajectory which is located behind a point 
defined by said location and orientation information associated with 
said surgical tool, and 

producing a different predetermined representation for that 
portion of said selected computed trajectory which is located in front 
of said point defined by said location and orientation information 
associated with said surgical took 

256. The method according to claim 242, wherein said determining 
procedure is performed according to the original coordinates of said 
auxiliary two-dimensional image and according to a trajectory 
associated with said selected activity-state. 

257. The method according to claim 242, wherein said image is two- 
dimensional. 

258. The method according to claim 242, wherein said image is an 
internal three-dimensional navigation image. 

259. The method according to claim 242, wherein said image is an 
external three-dimensional navigation image. 

260. The method according to claim 242, wherein said image is semi- 
transparent. 

261. The method according to claim 242, wherein said image is a 
quantitative model of said inspected organ. 

262. The method according to claim 242, wherein said image is manually 
corrected. 

-126- 



WO 02/064011 



PCT/IL02/00108 



263. The method according to claim 242, wherein said determining 
procedure and said associating procedure are repeated. 

264. The method according to claim 242, wherein said reconstructing 
procedure is performed by employing a plurality of two-dimensional 
images which belong to said selected activity-state, and a plurality of 
auxiliary two-dimensional images which belong to a plurality of 
activity-states other than the selected activity-state. 

265. The method according to claim 242, wherein said selected activity- 
state is substantially equal to a real time activity-state measurement 
of an organ timing signal. 

266. Method for displaying an image sequence of a moving inspected 
organ, the method comprising the procedures of: 

detecting an organ timing signal of said inspected organ, said 
organ timing signal defining an organ timing signal cycle; 

detecting a plurality of two-dimensional images of said inspected 
organ, using an image detector; 

detecting the location and orientation of said image detector; 

associating each of said two-dimensional images with said 
image detector location and orientation and with said detected organ 
timing signal; 

reconstructing a plurality of three-dimensional images from said 
two-dimensional images, each said three-dimensional images being 
reconstructed from two-dimensional images selected from said two- 
dimensional images, said selected two-dimensional images 
corresponding to a selected position within said organ timing signal 
cycle; 
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selecting one of said three-dimensional images according to a 
real-time reading of said organ timing signal; and 

displaying said selected three-dimensional image. 

267. The method according to claim 266, further comprising the following 
procedures, after said procedure of selecting: 

detecting the location and orientation of a surgical tool; and 
superimposing a representation of said surgical tool onto said 

selected three-dimensional image, according to said detected 

location and orientation of said surgical tool. 

268. The method according to claim 266, further comprising the following 
procedures, after said procedure of selecting: 

detecting the location and orientation of a surgical tool; and 
superimposing a representation of said detected location and 

orientation of said surgical tool, onto said selected three-dimensional 

image. 

269. The method according to claim 266, further comprising the following 
procedures, prior to said procedure of displaying: 

detecting a real time image; and 

superimposing a projection of said selected three-dimensional 
image, onto said detected real time image. 

270. The method according to claim 267, wherein said detected location 
and orientation of said surgical tool and said detected location and 
orientation of said image detector, both reside in a single coordinate 
system. 

271. The method according to claim 267, wherein said surgical tool is 
selected from the list consisting of: 
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clamp; 

laser cutter; 

brush; 

catheter; 

stent; 

balloon; 

pace maker electrode; 
solution dispensing unit; 
neuron electrode; 
substance collection unit; 
surgical delivery tool; 
gene delivery tool; 
drug delivery tool; 
device delivery tool; 
ablation catheter; 
endoscope; 

electrophysiological mapping device; 
imaging device; and 
a combination thereof. 



272. The method according to claim 267, wherein said representation of 
said surgical tool indicates an estimated location of said surgical tool. 

273. The method according to claim 267, wherein said representation of 
said surgical tool indicates the orientation of said surgical tool. 

274. The method according to claim 267, wherein said representation of 
said surgical tool is in the form of a cursor. 
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275. The method according to claim 267, wherein said representation of 
said surgical tool is a pseudo realistic visualization of said surgical 
tool. 

276. The method according to claim 267, wherein said representation of 
said surgical tool comprises a projection of a three-dimensional 
representation of said representation of said surgical tool, on a real 
time image. 

277. The method according to claim 266, wherein said procedure of 
reconstruction is performed further according to the location and 
orientation information associated with each said selected two- 
dimensional images. 

278. Medical imaging and navigation system according to any of claims 
1-39 substantially as described hereinabove. 

279. Medical imaging and navigation system according to any of claims 
1-39 substantially as illustrated in any of the drawings. 

280. Method for displaying an image sequence of a moving inspected 
organ according to any of claims 40-119 substantially as described 
hereinabove. 

281. Method for displaying an image sequence of a moving inspected 
organ according to any of claims 40-1 19 substantially as illustrated in 
any of the drawings. 

282. Medical imaging and navigation system according to any of claims 
149-192 substantially as described hereinabove. 
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283. Medical imaging and navigation system according to any of claims 
149-192 substantially as illustrated in any of the drawings. 

284. Graphical user interface according to any of claims 193-226 
substantially as described hereinabove. 

285. Graphical user interface according to any of claims 193-226 
substantially as illustrated in any of the drawings. 

286. Method for reconstructing an image according to any of claims 
242-265 substantially as described hereinabove. 

287. Method for reconstructing an image according to any of claims 
242-265 substantially as illustrated in any of the drawings. 

288. Method for displaying an image sequence of a moving inspected 
organ according to any of claims 266-277 substantially as described 
hereinabove. 

289. Method for displaying an image sequence of a moving inspected 
organ according to any of claims 266-277 substantially as illustrated 
in any of the drawings. 
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FIG. 13A 
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FIG. 23C 
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FIG. 24 
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FIG. 26 
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